00000001:02000400:1.0F:1783349648.161019:0:3301:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1783349663.643932:0:3523:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1783349664.997021:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 779 MB/s 00000001:01000000:3.0:1783349665.246971:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1039 MB/s 00000001:01000000:0.0F:1783349665.497018:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4967 MB/s 00000020:02000000:2.0:1783349666.197932:0:3615:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_84_g95d2d66 00000400:02000000:2.0:1783349666.898261:0:3630:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.150@tcp [8/256/0/180] 00008000:02000000:1.0:1783349669.895479:0:3780:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1783349715.384512:0:5744:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1783349725.722921:0:6494:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783349725.722929:0:6494:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783349725.722930:0:6494:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783349725.723066:0:6494:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000eab16b2a 00000080:02000400:1.0:1783349725.723076:0:6494:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1783349725.730695:0:6494:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1783349725.730709:0:6494:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783349725.730741:0:6494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000df5ad7cb) 00000020:00000080:1.0:1783349725.730757:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783349725.776585:0:6494:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1783349725.776665:0:6494:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1783349725.799885:0:6494:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783349725.800277:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783349725.800284:0:6494:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783349725.800295:0:6494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e1b59 00000020:01000004:0.0:1783349725.800302:0:6494:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783349725.800306:0:6494:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783349725.800311:0:6494:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eab16b2a from MGS 00000020:01000004:0.0:1783349725.800315:0:6494:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783349725.800334:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e69f42a3) 00000020:00000080:0.0:1783349725.800345:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783349725.800447:0:6494:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eab16b2a from MGS, refs=2 00080000:01000000:0.0:1783349725.800453:0:6494:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783349725.800458:0:6494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e1b67 00000100:00100000:0.0:1783349725.800543:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783349725.800655:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783349725.800661:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1783349725.801924:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1783349725.801935:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783349725.802932:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349725.803071:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783349725.803076:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783349725.803561:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783349725.803567:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783349725.803846:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783349725.803852:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783349725.804403:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349725.804406:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349725.804407:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349725.804642:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349725.804644:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349725.804646:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349725.805076:0:6494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783349725.809214:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1783349726.054720:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2439 MB/s 00000001:01000000:1.0:1783349726.304206:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3587 MB/s 00000001:01000000:1.0:1783349726.554485:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 503 MB/s 00000001:01000000:2.0:1783349726.804731:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 771 MB/s 00080000:10000000:2.0:1783349726.812699:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1783349726.825494:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783349726.828919:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783349726.832592:0:6494:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783349726.832659:0:6494:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783349726.833433:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783349726.833461:0:6494:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783349726.835318:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783349726.835476:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783349726.835482:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783349726.841771:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783349726.841787:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783349726.842956:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783349726.842967:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783349726.843680:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783349726.843702:0:6494:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.150@tcp' 00000020:01000004:2.0:1783349726.843704:0:6494:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783349726.843751:0:6494:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.150@tcp (typ=mgc) 00000020:00000080:2.0:1783349726.843769:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.150@tcp (00000000ea62e411) 00000020:00000080:2.0:1783349726.843784:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783349726.843872:0:6494:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e4b727f2@MGC192.168.203.150@tcp: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1783349726.844052:0:6494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.150@tcp-0 is initialized 00000040:01000000:2.0:1783349726.844059:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 1 is initialized 00000100:00080000:1.0:1783349726.845019:0:6513:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1783349726.849318:0:6514:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783349726.849369:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.150@tcp (uuid 6edd2b87-ce4c-4997-b296-e0eb4341b4ab) 00000020:00000080:2.0:1783349726.849390:0:6494:0:(genops.c:1406:class_connect()) connect: client 6edd2b87-ce4c-4997-b296-e0eb4341b4ab, cookie 0xd05e6ae1590e1b75 00000100:00080000:2.0:1783349726.849402:0:6494:0:(import.c:512:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783349726.849407:0:6494:0:(import.c:626:import_select_connection()) MGC192.168.203.150@tcp: import 00000000e4b727f2 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783349726.849453:0:6494:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a2a375ba x1869977659375744/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783349726.849539:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a2a375ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3645:1869977659375744:0@lo:250: 00000100:00100000:2.0:1783349726.849616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783349726.849673:0:6494:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS 00000020:01000004:2.0:1783349726.849688:0:6494:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783349726.849694:0:6494:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:1.0:1783349726.849872:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659375744 00000100:00100000:1.0:1783349726.849881:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659375744 00000100:00100000:1.0:1783349726.849924:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349726.849931:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005de00065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1869977659375744:12345-0@lo:250: 00010000:00080000:1.0:1783349726.849958:0:6510:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 6edd2b87-ce4c-4997-b296-e0eb4341b4ab@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:1.0:1783349726.849994:0:6510:0:(genops.c:1406:class_connect()) connect: client 6edd2b87-ce4c-4997-b296-e0eb4341b4ab, cookie 0xd05e6ae1590e1b7c 00000100:00080000:1.0:1783349726.850123:0:6510:0:(import.c:65:import_set_state_nolock()) 0000000090d78d4a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349726.850202:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005de00065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:3645:x1869977659375744:12345-0@lo:250: Request processed in 270us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349726.850215:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349726.850975:0:3645:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783349726.850985:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.150@tcp: connect to target with instance 0 00000100:00080000:2.0:1783349726.850993:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783349726.850997:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783349726.851001:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000e4b727f2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783349726.851004:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783349726.851934:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783349726.851945:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a2a375ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3645:1869977659375744:0@lo:250: 00000020:00000080:2.0:1783349726.851982:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000291c6cf0) 00000020:00000080:2.0:1783349726.851999:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00010000:2.0:1783349726.852206:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349726.872916:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783349726.873089:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783349726.873096:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783349726.875038:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783349726.875050:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783349726.876036:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783349726.876046:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1783349726.880564:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349726.880784:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1783349726.880792:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1783349726.881722:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783349726.881728:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783349726.947530:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349726.947779:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783349726.947786:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783349726.955939:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783349726.955960:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783349726.959445:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783349726.959624:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783349726.959631:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783349726.963606:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783349726.963626:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783349726.964770:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783349726.965008:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783349726.965014:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783349726.965947:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783349726.965958:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783349726.966749:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783349726.967007:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783349726.967014:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783349726.968479:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783349726.968491:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783349726.995937:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349726.996423:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783349726.996431:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783349726.999528:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783349726.999545:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783349727.002517:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783349727.002534:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783349727.004703:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783349727.004735:0:6494:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783349727.004741:0:6494:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783349727.004849:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783349727.004902:0:6494:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.150@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1783349727.004906:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783349727.004908:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783349727.004910:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349727.004911:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349727.004912:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349727.004914:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349727.004915:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783349727.004916:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783349727.004918:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349727.004924:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349727.004925:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349727.004926:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783349727.004928:0:6494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1783349727.004930:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783349727.004931:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783349727.004932:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349727.004932:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349727.004933:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349727.004934:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349727.004935:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783349727.004936:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783349727.004937:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349727.004937:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349727.004938:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349727.004939:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783349727.004973:0:6494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783349727.004991:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659375872:0@lo:253: 00000100:00100000:0.0:1783349727.005417:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349727.005466:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000035f31b13 going to sleep for 11 seconds 00000100:00100000:1.0:1783349727.005582:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659375872 00000100:00100000:1.0:1783349727.005590:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659375872 00000100:00100000:1.0:1783349727.005664:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349727.005672:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d208a7ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:6494:x1869977659375872:12345-0@lo:253: 20000000:01000000:1.0:1783349727.005730:0:6512:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783349727.005732:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1783349727.007476:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1783349727.007540:0:6512:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1783349727.007848:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783349727.011523:0:6534:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1783349727.012009:0:6512:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783349727.012014:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1783349727.012020:0:6512:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1783349727.012023:0:6512:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1783349727.012036:0:6512:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1783349727.012838:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783349727.013598:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1783349727.013615:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783349727.013633:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1783349727.013646:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1783349727.013658:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1783349727.013737:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1783349727.013745:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1783349727.013759:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1783349727.013767:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1783349727.013778:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1783349727.013782:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1783349727.013792:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1783349727.013806:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1783349727.013832:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783349727.013838:0:6512:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1783349727.013846:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783349727.014044:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1783349727.014065:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783349727.014080:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1783349727.014094:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1783349727.014120:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1783349727.014130:0:6512:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1783349727.014176:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1783349727.014194:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1783349727.014206:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1783349727.014464:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1783349727.014479:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1783349727.014487:0:6512:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1783349727.014507:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1783349727.014513:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1783349727.014523:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1783349727.014545:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1783349727.014607:0:6512:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1783349727.014625:0:6512:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1783349727.014631:0:6512:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1783349727.015570:0:6535:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1783349727.015832:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1783349727.015859:0:6512:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.150@tcp for mdt 20000000:01000000:3.0:1783349727.015862:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:3.0:1783349727.015900:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1783349727.015907:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1783349727.015921:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1783349727.015929:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:3.0:1783349727.015941:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1783349727.015949:0:6512:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1783349727.015961:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1783349727.015975:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1783349727.015999:0:6512:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783349727.016002:0:6512:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783349727.016006:0:6512:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783349727.016076:0:6512:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783349727.016079:0:6512:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783349727.016815:0:6536:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1783349727.017085:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1783349727.017111:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1783349727.017127:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1783349727.017163:0:6512:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783349727.017165:0:6512:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783349727.018363:0:6537:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1783349727.018562:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1783349727.018603:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1783349727.018618:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1783349727.018631:0:6512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783349727.018633:0:6512:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1783349727.018640:0:6512:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1783349727.018642:0:6512:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1783349727.018646:0:6512:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1783349727.018652:0:6512:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1783349727.019402:0:6538:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1783349727.019525:0:6512:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1783349727.034480:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1783349727.034521:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1783349727.034538:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1783349727.034559:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783349727.034581:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.034598:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.034608:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.034614:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.034620:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.034627:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.034633:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008050370b already unused, calling callback (00000000c7f91d1d) 00010000:00010000:3.0:1783349727.034637:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.034645:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.034657:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.034664:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.034684:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008050370b/0xd05e6ae1590e1b8a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783349727.034714:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783349727.066572:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d208a7ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:6494:x1869977659375872:12345-0@lo:253: Request processed in 60893us (61148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.066594:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783349727.074728:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659375872:0@lo:253: 10000000:01000000:0.0:1783349727.074755:0:6494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783349727.074758:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783349727.074760:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783349727.074762:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349727.074763:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1783349727.074764:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349727.074765:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349727.074767:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783349727.074768:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783349727.074770:0:6494:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783349727.074771:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349727.074773:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783349727.074802:0:6494:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eab16b2a from lustre-MDT0000 10000000:01000000:0.0:1783349727.074835:0:6494:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783349727.074838:0:6494:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783349727.074842:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ea349f8b380 10000000:01000000:0.0:1783349727.074860:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783349727.074868:0:6494:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ea349f8b380 from 1 10000000:01000000:0.0:1783349727.074870:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783349727.074924:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.074934:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.074943:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349727.074963:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376000:0@lo:101: 00000100:00100000:0.0:1783349727.075031:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349727.075115:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055b2e2e4 going to sleep for 11 seconds 00000100:00100000:1.0:1783349727.075211:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659376000 00000100:00100000:1.0:1783349727.075218:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659376000 00000100:00100000:1.0:1783349727.075279:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783349727.075287:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1e393c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:6494:x1869977659376000:12345-0@lo:101: 00010000:00010000:1.0:1783349727.075301:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349727.075315:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1b98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1b91 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.075338:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1b91 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.075347:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1b91 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.075357:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a7dbfca, rc 0) 00000100:00100000:1.0:1783349727.075399:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1e393c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:6494:x1869977659376000:12345-0@lo:101: Request processed in 113us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349727.075412:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783349727.075630:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376000:0@lo:101: 00010000:00010000:0.0:1783349727.075643:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.075651:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349727.075724:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376128:0@lo:501: 00000100:00100000:0.0:1783349727.075751:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349727.075779:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055b2e2e4 going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.076327:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659376128 00000100:00100000:3.0:1783349727.076335:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659376128 00000100:00100000:3.0:1783349727.076411:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783349727.076418:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c47b2e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:6494:x1869977659376128:12345-0@lo:501: 00000100:00100000:3.0:1783349727.076527:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c47b2e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:6494:x1869977659376128:12345-0@lo:501: Request processed in 109us (776us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783349727.076534:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349727.076947:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376128:0@lo:501: 10000000:01000000:0.0:1783349727.076989:0:6494:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783349727.077012:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.077029:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349727.077038:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea3461c1000 10000000:01000000:0.0:1783349727.077042:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783349727.077047:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ea3461c1000 10000000:01000000:0.0:1783349727.077049:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783349727.077052:0:6494:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8ea3461c1000 from 1 10000000:01000000:0.0:1783349727.077054:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783349727.077092:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000bdc324fa/0xd05e6ae1590e1b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.077099:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000bdc324fa/0xd05e6ae1590e1b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.077107:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000bdc324fa/0xd05e6ae1590e1b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349727.077121:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376256:0@lo:101: 00000100:00100000:0.0:1783349727.077193:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349727.077214:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055b2e2e4 going to sleep for 11 seconds 00000100:00100000:1.0:1783349727.077652:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659376256 00000100:00100000:1.0:1783349727.077660:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659376256 00000100:00100000:1.0:1783349727.077703:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783349727.077711:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000091a058e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:6494:x1869977659376256:12345-0@lo:101: 00010000:00010000:1.0:1783349727.077722:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349727.077734:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ed341efe/0xd05e6ae1590e1ba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1b9f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.077754:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ed341efe/0xd05e6ae1590e1ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1b9f expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.077763:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ed341efe/0xd05e6ae1590e1ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1b9f expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.077772:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ed341efe, rc 0) 00000100:00100000:1.0:1783349727.077816:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000091a058e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+7:6494:x1869977659376256:12345-0@lo:101: Request processed in 107us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349727.077823:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783349727.077937:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376256:0@lo:101: 00010000:00010000:0.0:1783349727.077951:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000bdc324fa/0xd05e6ae1590e1b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.077958:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000bdc324fa/0xd05e6ae1590e1b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349727.077986:0:6494:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783349727.078002:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000bdc324fa/0xd05e6ae1590e1b9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.078008:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000bdc324fa/0xd05e6ae1590e1b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349727.078014:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783349727.078018:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783349727.078023:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ea3461c1000 10000000:01000000:0.0:1783349727.078025:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783349727.078028:0:6494:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783349727.078030:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783349727.078046:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.078052:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.078069:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349727.078083:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376384:0@lo:101: 00000100:00100000:0.0:1783349727.078112:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349727.078165:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055b2e2e4 going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.079383:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659376384 00000100:00100000:3.0:1783349727.079394:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659376384 00000100:00100000:3.0:1783349727.080087:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349727.080102:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad04764d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+7:6494:x1869977659376384:12345-0@lo:101: 00010000:00010000:3.0:1783349727.080123:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349727.080174:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008050370b/0xd05e6ae1590e1bb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1bad expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.080218:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008050370b/0xd05e6ae1590e1bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1bad expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.080232:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008050370b/0xd05e6ae1590e1bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1bad expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.080263:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008050370b, rc 0) 00000100:00100000:3.0:1783349727.080347:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad04764d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+8:6494:x1869977659376384:12345-0@lo:101: Request processed in 250us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.080354:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783349727.080427:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376384:0@lo:101: 00010000:00010000:0.0:1783349727.080460:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.080483:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349727.080560:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376512:0@lo:501: 00000100:00100000:0.0:1783349727.080596:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349727.085702:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055b2e2e4 going to sleep for 11 seconds 00000100:00100000:2.0:1783349727.090609:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659376512 00000100:00100000:2.0:1783349727.090626:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659376512 00000100:00100000:2.0:1783349727.090686:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783349727.090694:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fcdb93b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+8:6494:x1869977659376512:12345-0@lo:501: 00000100:00100000:2.0:1783349727.091871:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fcdb93b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:6494:x1869977659376512:12345-0@lo:501: Request processed in 1171us (11268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349727.091883:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349727.092078:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376512:0@lo:501: 00000100:00100000:0.0:1783349727.092188:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376640:0@lo:503: 00000100:00100000:0.0:1783349727.092413:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349727.092458:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055b2e2e4 going to sleep for 11 seconds 00000100:00100000:2.0:1783349727.092571:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659376640 00000100:00100000:2.0:1783349727.092579:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659376640 00000100:00100000:2.0:1783349727.092613:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349727.092620:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2c81881 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:6494:x1869977659376640:12345-0@lo:503: 00000100:00100000:2.0:1783349727.092718:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2c81881 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:6494:x1869977659376640:12345-0@lo:503: Request processed in 99us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349727.092728:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783349727.093178:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659376640:0@lo:503: 00000100:00100000:1.0:1783349727.096719:0:6539:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000745299c1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6539:1869977659376768:0@lo:502: 00000100:00100000:1.0:1783349727.096809:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349727.096871:0:6539:0:(client.c:2701:ptlrpc_set_wait()) set 000000004200cffd going to sleep for 11 seconds 00000100:00100000:2.0:1783349727.097203:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659376768 00000100:00100000:2.0:1783349727.097212:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659376768 00000100:00100000:2.0:1783349727.097439:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783349727.097450:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b12d1cf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:6539:x1869977659376768:12345-0@lo:502: 00000100:00100000:2.0:1783349727.097578:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b12d1cf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:6539:x1869977659376768:12345-0@lo:502: Request processed in 131us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349727.097586:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349727.098690:0:6539:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000745299c1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6539:1869977659376768:0@lo:502: 00000020:01000000:3.0:1783349727.098733:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349727.098746:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349727.098748:0:6539:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783349727.098752:0:6539:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783349727.098755:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783349727.098783:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d754f28b) 00000020:00000080:3.0:1783349727.098803:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783349727.098811:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783349727.098992:0:6539:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783349727.099003:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e1bc2 00000020:00000080:2.0:1783349727.099965:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783349727.099973:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349727.099978:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349727.099980:0:6539:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783349727.099984:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349727.099988:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349727.099989:0:6539:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783349727.099993:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783349727.100003:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000009b1dede) 00000020:00000080:2.0:1783349727.100018:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783349727.100022:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783349727.100024:0:6539:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783349727.100027:0:6539:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783349727.100032:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783349727.100085:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eab16b2a from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783349727.100096:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006bc64a00) 00000020:00000080:2.0:1783349727.100102:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783349727.100340:0:6539:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783349727.100346:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e1bd7 00000020:00000080:2.0:1783349727.100466:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783349727.100472:0:6539:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783349727.100478:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd05e6ae1590e1bde 00080000:01000000:2.0:1783349727.100483:0:6539:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783349727.100486:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e1be5 00080000:10000000:2.0:1783349727.101068:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1783349727.102010:0:6539:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1783349727.112446:0:6539:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1783349727.179288:0:6539:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1783349727.179939:0:6539:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1783349727.182726:0:6539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1783349727.183077:0:6539:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783349727.187804:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000008375385f) 00000020:00000080:1.0:1783349727.187832:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1783349727.187919:0:6539:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783349727.187926:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e1bf3 00000020:00000080:0.0:1783349727.190930:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1783349727.192022:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1783349727.195982:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1783349727.199197:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1783349727.202028:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1783349727.204799:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1783349727.209243:0:6539:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1783349727.211399:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd05e6ae1590e1bfa 00000020:00000080:2.0:1783349727.214408:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783349727.214421:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349727.214427:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349727.214429:0:6539:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783349727.214433:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349727.214436:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349727.214438:0:6539:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783349727.214440:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783349727.214442:0:6539:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783349727.214444:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349727.214446:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349727.214447:0:6539:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783349727.214449:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349727.214463:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349727.214465:0:6539:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783349727.214470:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783349727.214521:0:6539:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1783349727.214587:0:6539:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a2a375ba pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6539:1869977659376896:0@lo:502: 00000100:00100000:2.0:1783349727.214666:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349727.214745:0:6539:0:(client.c:2701:ptlrpc_set_wait()) set 000000004ccc7d9a going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.214936:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659376896 00000100:00100000:3.0:1783349727.214944:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659376896 00000100:00100000:3.0:1783349727.214985:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349727.214997:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a673b86e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:6539:x1869977659376896:12345-0@lo:502: 00000100:00100000:3.0:1783349727.215119:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a673b86e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:6539:x1869977659376896:12345-0@lo:502: Request processed in 122us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.215127:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783349727.215266:0:6539:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a2a375ba pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6539:1869977659376896:0@lo:502: 00000020:01000000:0.0:1783349727.215293:0:6539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349727.215298:0:6539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349727.215301:0:6539:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1783349727.215305:0:6539:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783349727.215458:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783349727.215479:0:6494:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783349727.215509:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.215519:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349727.215528:0:6494:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea3461c1000 from 1 10000000:01000000:1.0:1783349727.215530:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783349727.215557:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.215564:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.215572:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349727.215586:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000599e2d94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377024:0@lo:101: 00000100:00100000:1.0:1783349727.215617:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349727.215647:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000064a5b097 going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.215705:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659377024 00000100:00100000:3.0:1783349727.215709:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659377024 00000100:00100000:3.0:1783349727.215742:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349727.215748:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a871cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:6494:x1869977659377024:12345-0@lo:101: 00010000:00010000:3.0:1783349727.215766:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349727.215778:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1c08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1c01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.215798:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c01 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.215808:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c01 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.215816:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e738fdfa, rc 0) 00000100:00100000:3.0:1783349727.215853:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a871cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:6494:x1869977659377024:12345-0@lo:101: Request processed in 105us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.215859:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783349727.215962:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000599e2d94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377024:0@lo:101: 00010000:00010000:1.0:1783349727.215974:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.215982:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349727.216841:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000599e2d94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377152:0@lo:256: 00000100:00100000:1.0:1783349727.216898:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349727.218992:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000064a5b097 going to sleep for 11 seconds 00000100:00100000:2.0:1783349727.219060:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659377152 00000100:00100000:2.0:1783349727.219069:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659377152 00000100:00100000:2.0:1783349727.219122:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783349727.219130:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027fd15c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:6494:x1869977659377152:12345-0@lo:256: 20000000:01000000:2.0:1783349727.219177:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783349727.219183:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783349727.219292:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027fd15c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:6494:x1869977659377152:12345-0@lo:256: Request processed in 163us (2393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349727.219299:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783349727.219487:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000599e2d94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377152:0@lo:256: 10000000:01000000:1.0:1783349727.220075:0:6494:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783349727.220126:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.220171:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349727.220180:0:6494:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea3461c1000 from 1 10000000:01000000:1.0:1783349727.220183:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783349727.220213:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.220220:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.220227:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349727.220240:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000599e2d94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377280:0@lo:101: 00000100:00100000:1.0:1783349727.220273:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349727.220306:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000064a5b097 going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.220710:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659377280 00000100:00100000:3.0:1783349727.220720:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659377280 00000100:00100000:3.0:1783349727.220764:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783349727.220771:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085ba4908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:6494:x1869977659377280:12345-0@lo:101: 00010000:00010000:3.0:1783349727.220781:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349727.220794:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029a10864/0xd05e6ae1590e1c16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1c0f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.220813:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029a10864/0xd05e6ae1590e1c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c0f expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.220822:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029a10864/0xd05e6ae1590e1c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c0f expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.220829:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029a10864, rc 0) 00000100:00100000:3.0:1783349727.220925:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085ba4908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:6494:x1869977659377280:12345-0@lo:101: Request processed in 154us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.220932:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783349727.228862:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000599e2d94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377280:0@lo:101: 00010000:00010000:0.0:1783349727.228980:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349727.229012:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349727.229096:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377408:0@lo:501: 00000100:00100000:0.0:1783349727.230399:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349727.230498:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a8b756d5 going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.234028:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659377408 00000100:00100000:3.0:1783349727.234046:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659377408 00000100:00100000:3.0:1783349727.234166:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783349727.234176:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d28d9d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:6494:x1869977659377408:12345-0@lo:501: 00000100:00100000:3.0:1783349727.234416:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d28d9d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:6494:x1869977659377408:12345-0@lo:501: Request processed in 241us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.234425:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349727.234577:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377408:0@lo:501: 00000100:00100000:2.0:1783349727.234627:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006c039a03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377536:0@lo:503: 00000100:00100000:2.0:1783349727.234684:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349727.235065:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 000000003047e6ac going to sleep for 11 seconds 00000100:00100000:0.0:1783349727.235504:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659377536 00000100:00100000:0.0:1783349727.235512:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659377536 00000100:00100000:0.0:1783349727.235550:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783349727.235557:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2322ab1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:6494:x1869977659377536:12345-0@lo:503: 00000040:00080000:0.0:1783349727.235603:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783349727.235658:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2322ab1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:6494:x1869977659377536:12345-0@lo:503: Request processed in 101us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349727.235665:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783349727.235806:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006c039a03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377536:0@lo:503: 00000040:00080000:0.0:1783349727.240123:0:6543:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1783349727.240447:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1783349727.240469:0:6494:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783349727.240487:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.240499:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349727.240567:0:6494:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783349727.240570:0:6494:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea3461c1000 10000000:01000000:3.0:1783349727.240573:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea3461c1000 10000000:01000000:3.0:1783349727.240578:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783349727.240584:0:6494:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea3461c1000 from 1 10000000:01000000:3.0:1783349727.240586:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783349727.240649:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.240658:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.240680:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349727.240719:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000610da14f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377664:0@lo:101: 00000100:00100000:3.0:1783349727.240786:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349727.240828:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659377664 00000100:00100000:3.0:1783349727.240835:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659377664 00000100:00100000:3.0:1783349727.240872:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783349727.240880:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fdb35e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:6494:x1869977659377664:12345-0@lo:101: 00010000:00010000:3.0:1783349727.240903:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349727.240915:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1c1d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.240939:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c1d expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.240947:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c1d expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.240957:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092bfac3b, rc 0) 00000100:00100000:3.0:1783349727.240989:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fdb35e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6494:x1869977659377664:12345-0@lo:101: Request processed in 110us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.240996:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783349727.241047:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000076a7dc30 going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.241076:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000610da14f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377664:0@lo:101: 00010000:00010000:3.0:1783349727.241090:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.241109:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349727.241191:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000610da14f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377792:0@lo:501: 00000100:00100000:3.0:1783349727.241217:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349727.241230:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000076a7dc30 going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.241243:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659377792 00000100:00100000:3.0:1783349727.241246:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659377792 00000100:00100000:3.0:1783349727.241263:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783349727.241268:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034387866 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6494:x1869977659377792:12345-0@lo:501: 00000100:00100000:3.0:1783349727.241375:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034387866 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6494:x1869977659377792:12345-0@lo:501: Request processed in 106us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.241381:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783349727.241411:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000610da14f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377792:0@lo:501: 00000100:00100000:3.0:1783349727.241435:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000610da14f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377920:0@lo:503: 00000100:00100000:3.0:1783349727.241470:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349727.241482:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 0000000076a7dc30 going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.241495:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659377920 00000100:00100000:3.0:1783349727.241498:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659377920 00000100:00100000:3.0:1783349727.241514:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783349727.241518:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000beddda4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6494:x1869977659377920:12345-0@lo:503: 00000100:00100000:3.0:1783349727.241593:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000beddda4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6494:x1869977659377920:12345-0@lo:503: Request processed in 74us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.241599:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783349727.241639:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000610da14f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659377920:0@lo:503: 00000100:00100000:3.0:1783349727.241844:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000610da14f pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6544:1869977659378048:0@lo:502: 00000100:00100000:3.0:1783349727.241876:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349727.241906:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659378048 00000100:00100000:3.0:1783349727.241910:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659378048 00000100:00100000:3.0:1783349727.241927:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783349727.241931:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045feb285 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6544:x1869977659378048:12345-0@lo:502: 00000100:00100000:3.0:1783349727.241990:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045feb285 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6544:x1869977659378048:12345-0@lo:502: Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.241995:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783349727.242018:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set 000000009c5f06cd going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.242028:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000610da14f pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6544:1869977659378048:0@lo:502: 00000020:01000004:3.0:1783349727.242076:0:6544:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783349727.242090:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ca78bd0e) 00000020:00000080:3.0:1783349727.242107:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1783349727.242279:0:6544:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eab16b2a from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783349727.242282:0:6544:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000eab16b2a from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783349727.242285:0:6544:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000eab16b2a 4 00010000:00080000:3.0:1783349727.242310:0:6544:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c7edd073@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783349727.250385:0:6544:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1783349727.250516:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783349727.250558:0:6544:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783349727.250570:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd05e6ae1590e1c32 00000100:00080000:3.0:1783349727.250581:0:6544:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783349727.250586:0:6544:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c7edd073 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783349727.250619:0:6544:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000610da14f x1869977659378176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783349727.250652:0:6544:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783349727.250786:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000610da14f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659378176:0@lo:38: 00000100:00100000:0.0:1783349727.250856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349727.250925:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659378176 00000100:00100000:0.0:1783349727.250932:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659378176 00000100:00100000:0.0:1783349727.250961:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349727.250967:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000299147d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869977659378176:12345-0@lo:38: 00000100:00100000:0.0:1783349727.251015:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000299147d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869977659378176:12345-0@lo:38: Request processed in 47us (159us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783349727.251024:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349727.251058:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783349727.251064:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000c7edd073 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783349727.251075:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783349727.251078:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000610da14f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659378176:0@lo:38: 00000100:00100000:0.0:1783349727.251920:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d5240f6d pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6544:1869977659378304:0@lo:502: 00000100:00100000:0.0:1783349727.251975:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349727.252000:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cae9cce0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.252047:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659378304 00000100:00100000:3.0:1783349727.252053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659378304 00000100:00100000:3.0:1783349727.252095:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783349727.252101:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000254db4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6544:x1869977659378304:12345-0@lo:502: 00000100:00100000:3.0:1783349727.252251:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000254db4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6544:x1869977659378304:12345-0@lo:502: Request processed in 150us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.252258:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783349727.252565:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d5240f6d pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6544:1869977659378304:0@lo:502: 00000040:00080000:0.0:1783349727.252590:0:6544:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1783349727.252776:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1783349727.252799:0:6494:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783349727.252821:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.252832:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783349727.252882:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783349727.252893:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783349727.252894:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349727.252895:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349727.252897:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349727.252898:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349727.252899:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783349727.252901:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783349727.252902:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349727.252903:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349727.252905:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349727.252907:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783349727.252911:0:6494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1783349727.252913:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783349727.252914:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783349727.252915:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349727.252916:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349727.252917:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349727.252918:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349727.252926:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783349727.252927:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783349727.252927:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349727.252928:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349727.252929:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349727.252929:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783349727.252946:0:6494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783349727.252957:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ba52919a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659378432:0@lo:253: 00000100:00100000:3.0:1783349727.253003:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349727.253036:0:6494:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c4038496 going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.253251:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659378432 00000100:00100000:3.0:1783349727.253256:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659378432 00000100:00100000:3.0:1783349727.253783:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783349727.253793:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da8cac7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6494:x1869977659378432:12345-0@lo:253: 20000000:01000000:3.0:1783349727.253820:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783349727.253831:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783349727.264212:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783349727.264227:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783349727.264455:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783349727.264462:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783349727.264489:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.264511:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1c08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c01 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.264536:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.264575:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1c01 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.264590:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c01 expref: 12 pid: 6510 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349727.264604:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c2f84e53 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659378560:0@lo:104: 00000100:00100000:1.0:1783349727.264671:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349727.264730:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set 000000001fc8896b going to sleep for 11 seconds 00000100:00100000:3.0:1783349727.264941:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659378560 00000100:00100000:3.0:1783349727.264949:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659378560 00000100:00100000:3.0:1783349727.265008:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349727.265017:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a7d4a8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6533:x1869977659378560:12345-0@lo:104: 00010000:00010000:3.0:1783349727.265029:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349727.265084:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349727.265091:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a7d4a8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6533:x1869977659378560:12345-0@lo:104: Request processed in 75us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349727.265098:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349727.265180:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c2f84e53 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659378560:0@lo:104: 00010000:00010000:3.0:1783349727.265199:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.265697:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349727.265709:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.265716:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000023d30f99 already unused, calling callback (00000000a50e4db4) 10000000:00010000:1.0:1783349727.265719:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.265726:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349727.265733:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349727.265738:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349727.265776:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.265791:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349727.265810:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.265816:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 0000000023d30f99/0xd05e6ae1590e1c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c08 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.265833:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349727.265834:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349727.265835:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349727.265904:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028ade53e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659378688:0@lo:103: 00000100:00100000:1.0:1783349727.265939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349727.266023:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659378688 00000100:00100000:1.0:1783349727.266028:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659378688 00010000:00010000:1.0:1783349727.266043:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c01 expref: 13 pid: 6510 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349727.266061:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349727.266065:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030aff97a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:3647:x1869977659378688:12345-0@lo:103: 00010000:00010000:1.0:1783349727.266074:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349727.266078:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c01 expref: 13 pid: 6510 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266085:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c01 expref: 13 pid: 6510 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266096:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1c08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1c01 expref: 13 pid: 6510 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266116:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266123:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783349727.266793:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002332990s 00010000:00010000:1.0:1783349727.266800:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266808:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266814:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266820:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266825:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a02702e already unused, calling callback (00000000c7f91d1d) 00010000:00010000:1.0:1783349727.266828:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266834:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266858:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349727.266868:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349727.266920:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349727.266928:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030aff97a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:3647:x1869977659378688:12345-0@lo:103: Request processed in 860us (988us total) trans 0 rc 0/0 00010000:00010000:0.0:1783349727.266935:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349727.266940:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783349727.266948:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c39 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349727.266984:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028ade53e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659378688:0@lo:103: 00000100:00100000:0.0:1783349727.267726:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da8cac7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:6494:x1869977659378432:12345-0@lo:253: Request processed in 13932us (14719us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349727.267737:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783349727.269175:0:6494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ba52919a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6494:1869977659378432:0@lo:253: 10000000:01000000:3.0:1783349727.269197:0:6494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783349727.269200:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783349727.269202:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783349727.269203:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349727.269204:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349727.269205:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349727.269206:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349727.269208:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783349727.269209:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783349727.269211:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349727.269212:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349727.269213:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349727.269214:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783349727.269230:0:6494:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783349727.278237:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1783349727.278433:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783349727.278604:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1783349727.278763:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783349727.278950:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1783349727.279098:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1783349727.281614:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1783349727.281844:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1783349727.282032:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1783349727.282192:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1783349727.282362:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1783349727.282513:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1783349727.295624:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783349727.314754:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783349727.314765:0:6549:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1783349727.314769:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1783349727.315023:0:6550:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783349727.316816:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783349727.316974:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783349727.317692:0:6494:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783349727.317701:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783349727.317806:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783349727.320849:0:6494:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783349727.321643:0:6494:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783349727.321689:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783349727.322039:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783349727.322490:0:6494:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1783349727.323467:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783349727.323593:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783349727.323823:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783349727.324403:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783349727.324560:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1783349727.324796:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783349727.324995:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783349727.325228:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783349727.325479:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000040:00080000:3.0:1783349727.325528:0:6550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1783349727.325614:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783349727.325867:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783349727.327302:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783349727.327526:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783349727.327681:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783349727.327873:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783349727.331371:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783349727.331753:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783349727.331918:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783349727.333664:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783349727.333865:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000040:00080000:3.0:1783349727.334042:0:6550:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783349727.334122:0:6550:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783349727.334127:0:6550:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1783349727.334479:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783349727.335527:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1783349727.335707:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783349727.335849:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783349727.336027:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1783349727.336247:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1783349727.336394:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1783349727.336537:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1783349727.336679:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1783349727.336828:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1783349727.337478:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1783349727.337624:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1783349727.337816:0:6494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1783349727.340597:0:6494:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783349727.340643:0:6494:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9d9841c9f988 00100000:10000000:2.0:1783349727.340649:0:6494:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783349727.341522:0:6494:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783349727.341535:0:6494:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783349727.341549:0:6494:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783349727.341563:0:6494:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783349727.346665:0:6494:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783349727.346840:0:6494:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1783349727.876468:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349728.907270:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349729.924275:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349730.903416:0:6794:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783349730.955407:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783349731.589843:0:6846:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783349731.590041:0:6846:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783349731.975222:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783349732.742456:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783349732.742467:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783349732.742488:0:37:0:(import.c:65:import_set_state_nolock()) 00000000c7edd073 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783349732.742502:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c7edd073 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783349732.742527:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000071476d66 x1869977659378944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783349732.742616:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349732.742633:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ba52919a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659378816:0@lo:400: 00000100:00100000:2.0:1783349732.742710:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349732.742949:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000071476d66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659378944:0@lo:38: 00000100:00100000:0.0:1783349732.742987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349732.743030:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659378816 00000100:00100000:0.0:1783349732.743037:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659378816 00000100:00100000:0.0:1783349732.743081:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783349732.743089:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000416eff2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:3649:x1869977659378816:12345-0@lo:400: 00000100:00100000:0.0:1783349732.743191:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000416eff2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:3649:x1869977659378816:12345-0@lo:400: Request processed in 102us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349732.743199:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783349732.743213:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ba52919a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659378816:0@lo:400: 00000100:00100000:3.0:1783349732.743932:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659378944 00000100:00100000:3.0:1783349732.743940:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659378944 00000100:00100000:3.0:1783349732.743974:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349732.743978:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5240f6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659378944:12345-0@lo:38: 00010000:00080000:3.0:1783349732.744001:0:6519:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1783349732.744032:0:6519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd05e6ae1590e1c40 00000004:00100000:3.0:1783349732.744106:0:6519:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783349732.744268:0:6519:0:(import.c:65:import_set_state_nolock()) 00000000b5da088d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349732.744386:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5240f6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869977659378944:12345-0@lo:38: Request processed in 406us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349732.744394:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783349732.748417:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000071476d66 x1869977659378944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783349732.748439:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783349732.748446:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783349732.748451:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783349732.748454:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000c7edd073 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783349732.748460:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000071476d66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659378944:0@lo:38: 00010000:00010000:1.0:1783349732.996726:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349734.021251:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783349734.154086:0:6948:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783349734.154371:0:6948:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783349735.055613:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783349735.812204:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783349735.812213:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea3461c1000 from 3 10000000:01000000:3.0:1783349735.812218:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783349735.812263:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349735.812275:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349735.812284:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349735.812307:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000057395eda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659379072:0@lo:101: 00000100:00100000:3.0:1783349735.812386:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349735.812425:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 000000009c707491 going to sleep for 11 seconds 00000100:00100000:0.0:1783349735.812888:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659379072 00000100:00100000:0.0:1783349735.812897:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659379072 00000100:00100000:0.0:1783349735.812952:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783349735.812960:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035a9e914 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:6514:x1869977659379072:12345-0@lo:101: 00010000:00010000:0.0:1783349735.812973:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349735.812986:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003bd9d880/0xd05e6ae1590e1c4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1c47 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349735.813009:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bd9d880/0xd05e6ae1590e1c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c47 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349735.813018:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003bd9d880/0xd05e6ae1590e1c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c47 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349735.813026:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003bd9d880, rc 0) 00000100:00100000:0.0:1783349735.813075:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035a9e914 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6514:x1869977659379072:12345-0@lo:101: Request processed in 116us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349735.813091:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783349735.813882:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000057395eda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659379072:0@lo:101: 00010000:00010000:2.0:1783349735.813904:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349735.813919:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349735.813977:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006c039a03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659379200:0@lo:256: 00000100:00100000:2.0:1783349735.814022:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349735.814055:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f2d9adc7 going to sleep for 11 seconds 00000100:00100000:1.0:1783349735.814114:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659379200 00000100:00100000:1.0:1783349735.814120:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659379200 00000100:00100000:1.0:1783349735.814189:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349735.814196:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002030f196 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6514:x1869977659379200:12345-0@lo:256: 20000000:01000000:1.0:1783349735.814210:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783349735.814230:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783349735.814233:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1783349735.814309:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002030f196 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6514:x1869977659379200:12345-0@lo:256: Request processed in 114us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349735.814315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783349735.814430:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006c039a03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659379200:0@lo:256: 10000000:01000000:2.0:1783349735.814471:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783349735.814481:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349735.814488:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349736.073325:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349737.093744:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349737.860916:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b3cff4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659379328:0@lo:400: 00000100:00100000:1.0:1783349737.860982:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001bc42efc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659379456:0@lo:400: 00000100:00100000:2.0:1783349737.860990:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349737.861039:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349737.861115:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659379456 00000100:00100000:3.0:1783349737.861122:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659379456 00000100:00100000:0.0:1783349737.861160:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659379328 00000100:00100000:0.0:1783349737.861167:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659379328 00000100:00100000:3.0:1783349737.861186:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349737.861195:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028ade53e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659379456:12345-0@lo:400: 00000100:00100000:3.0:1783349737.861310:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028ade53e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659379456:12345-0@lo:400: Request processed in 116us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349737.861317:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783349737.861328:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001bc42efc x1869977659379456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349737.861342:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001bc42efc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659379456:0@lo:400: 00000100:00100000:0.0:1783349737.862216:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783349737.862231:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014d8610b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:3649:x1869977659379328:12345-0@lo:400: 00000100:00100000:0.0:1783349737.862730:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014d8610b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:3649:x1869977659379328:12345-0@lo:400: Request processed in 500us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349737.862740:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783349737.863079:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b3cff4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659379328:0@lo:400: 00010000:00010000:3.0:1783349738.116549:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349739.142889:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349740.170893:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349741.194157:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349742.218608:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783349742.420255:0:7446:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783349742.420259:0:7446:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783349742.420260:0:7446:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783349742.420398:0:7446:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000000551d221 00000020:01000004:0.0:1783349742.420417:0:7446:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1783349742.420428:0:7446:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783349742.420441:0:7446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000007b2bbcdd) 00000020:00000080:0.0:1783349742.420457:0:7446:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783349742.482447:0:7446:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1783349742.482533:0:7446:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1783349742.501512:0:7446:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783349742.501723:0:7446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1783349742.501732:0:7446:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783349742.501743:0:7446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e1c5c 00000020:01000004:2.0:1783349742.501750:0:7446:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783349742.501789:0:7446:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783349742.501792:0:7446:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783349742.501799:0:7446:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1783349742.501839:0:7446:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1783349742.501843:0:7446:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1783349742.514593:0:7446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783349742.514635:0:7446:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.150@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1783349742.514639:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783349742.514641:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783349742.514642:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349742.514643:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349742.514644:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349742.514646:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349742.514647:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783349742.514648:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349742.514649:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349742.514651:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349742.514652:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783349742.514656:0:7446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1783349742.514658:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783349742.514660:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783349742.514661:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349742.514662:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349742.514663:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349742.514664:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349742.514664:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783349742.514670:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349742.514671:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349742.514672:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349742.514673:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783349742.514697:0:7446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783349742.514713:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659379584:0@lo:253: 00000100:00100000:3.0:1783349742.514795:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.514910:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a5f24756 going to sleep for 11 seconds 00000100:00100000:0.0:1783349742.514999:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659379584 00000100:00100000:0.0:1783349742.515007:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659379584 00000100:00100000:0.0:1783349742.515126:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783349742.515165:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002271f6f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659379584:12345-0@lo:253: 20000000:01000000:0.0:1783349742.515208:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783349742.515212:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1783349742.515217:0:6510:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1783349742.515220:0:6510:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1783349742.515251:0:6510:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1783349742.515447:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349742.515563:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1783349742.515578:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783349742.515596:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1783349742.515613:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1783349742.515628:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1783349742.515678:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1783349742.515686:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1783349742.515699:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1783349742.515705:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1783349742.515716:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1783349742.515720:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1783349742.515733:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1783349742.515748:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1783349742.515871:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1783349742.515880:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:0.0:1783349742.515893:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1783349742.515899:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783349742.515911:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1783349742.515917:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:0.0:1783349742.515929:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1783349742.515935:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1783349742.515946:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1783349742.515961:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1783349742.515971:0:6510:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1783349742.516050:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1783349742.516059:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1783349742.516072:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1783349742.516090:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1783349742.516106:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1783349742.516112:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1783349742.516159:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1783349742.516184:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1783349742.516190:0:6510:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1783349742.516214:0:6510:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1783349742.516221:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1783349742.516740:0:7452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1783349742.517019:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1783349742.517039:0:6510:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.150@tcp for mdt 20000000:01000000:3.0:1783349742.517041:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:3.0:1783349742.517054:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1783349742.517059:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1783349742.517072:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1783349742.517079:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:3.0:1783349742.517093:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1783349742.517101:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1783349742.517115:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1783349742.517194:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1783349742.517347:0:6510:0:(mgs_llog.c:3426:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1783349742.517358:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1783349742.517684:0:7453:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1783349742.517824:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1783349742.517838:0:6510:0:(mgs_llog.c:3484:mgs_write_log_osp_to_mdt()) add nid 192.168.203.150@tcp for mdt 20000000:01000000:0.0:1783349742.517840:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:0.0:1783349742.517851:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1783349742.517856:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783349742.517867:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1783349742.517871:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:0.0:1783349742.517881:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1783349742.517887:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1783349742.517896:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1783349742.517908:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1783349742.517923:0:6510:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783349742.517926:0:6510:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783349742.517929:0:6510:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783349742.517970:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783349742.517972:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783349742.518550:0:7454:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1783349742.518575:0:7454:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1783349742.518588:0:7454:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1783349742.518735:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1783349742.518754:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1783349742.518778:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1783349742.518788:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783349742.518789:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783349742.519065:0:7455:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1783349742.519080:0:7455:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1783349742.519092:0:7455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1783349742.519482:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1783349742.519500:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1783349742.519514:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1783349742.519522:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783349742.519530:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783349742.519757:0:7456:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1783349742.519785:0:7456:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1783349742.519799:0:7456:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1783349742.519936:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1783349742.519954:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1783349742.519977:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1783349742.519991:0:6510:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783349742.519993:0:6510:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783349742.519998:0:6510:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783349742.520003:0:6510:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1783349742.520744:0:7457:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1783349742.520877:0:6510:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783349742.531398:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783349742.531429:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.531450:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1b91 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.531457:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008050370b/0xd05e6ae1590e1bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1bad expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.531464:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c1d expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.531471:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.531517:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1c1d expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.531533:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c1d expref: 12 pid: 6512 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349742.531567:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e6246c01 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659379712:0@lo:104: 00000100:00100000:0.0:1783349742.531635:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349742.531844:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008050370b/0xd05e6ae1590e1bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1bad expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.531853:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008050370b/0xd05e6ae1590e1bb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1bad expref: 12 pid: 6512 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349742.531862:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004f32bc8a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659379840:0@lo:104: 00000100:00100000:0.0:1783349742.531886:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349742.531984:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1b91 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.532002:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1b98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1b91 expref: 12 pid: 6511 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349742.532009:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006044ad21 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659379968:0@lo:104: 00000100:00100000:0.0:1783349742.532201:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349742.533284:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659379712 00000100:00100000:1.0:1783349742.533295:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659379712 00000100:00100000:1.0:1783349742.533345:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659379840 00000100:00100000:1.0:1783349742.533349:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659379840 00000100:00100000:1.0:1783349742.533367:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349742.533376:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057fed08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6510:x1869977659379712:12345-0@lo:104: 00010000:00010000:1.0:1783349742.533392:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349742.533407:0:6510:0:(client.c:2701:ptlrpc_set_wait()) set 00000000467542a9 going to sleep for 11 seconds 00000100:00100000:3.0:1783349742.533507:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659379968 00000100:00100000:3.0:1783349742.533513:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659379968 00000100:00100000:0.0:1783349742.533562:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e6246c01 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659379712:0@lo:104: 00010000:00010000:1.0:1783349742.533572:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783349742.533579:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057fed08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:6510:x1869977659379712:12345-0@lo:104: Request processed in 205us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.533587:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349742.533608:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1783349742.533610:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349742.533616:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349742.533617:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3d53eb2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6510:x1869977659379840:12345-0@lo:104: 00010000:00010000:1.0:1783349742.533629:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.533630:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000767ae7f8 already unused, calling callback (00000000a50e4db4) 10000000:00010000:2.0:1783349742.533636:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.533648:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349742.533672:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349742.533679:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349742.533679:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783349742.533688:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3d53eb2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6510:x1869977659379840:12345-0@lo:104: Request processed in 74us (1801us total) trans 0 rc 0/0 00010000:00010000:3.0:1783349742.533703:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349742.533723:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.533732:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349742.533757:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.533780:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 00000000767ae7f8/0xd05e6ae1590e1c1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.533800:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349742.533803:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349742.533805:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349742.533826:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006c039a03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659380096:0@lo:103: 00000100:00100000:2.0:1783349742.533869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349742.533888:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349742.533894:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.533903:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007caae275 already unused, calling callback (00000000a50e4db4) 10000000:00010000:3.0:1783349742.533906:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.533914:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349742.533915:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659380096 00000100:00100000:2.0:1783349742.533921:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659380096 10000000:00010000:3.0:1783349742.533923:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349742.533930:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349742.533942:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c1d expref: 13 pid: 6512 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.533952:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.533960:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783349742.533970:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783349742.533975:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349742.533980:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050340efe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:3647:x1869977659380096:12345-0@lo:103: 00010000:00010000:3.0:1783349742.533990:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1bad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1bb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.533995:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349742.534002:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349742.534002:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c1d expref: 13 pid: 6512 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.534005:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349742.534007:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349742.534017:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000052ea8044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659380224:0@lo:103: 00010000:00010000:2.0:1783349742.534024:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c1d expref: 13 pid: 6512 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.534044:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1c1d expref: 13 pid: 6512 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.534057:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349742.534059:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349742.534097:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050340efe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:3647:x1869977659380096:12345-0@lo:103: Request processed in 120us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349742.534103:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783349742.534105:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349742.534115:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1783349742.534131:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659380224 00000100:00100000:2.0:1783349742.534167:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659380224 00010000:00010000:2.0:1783349742.534183:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008050370b/0xd05e6ae1590e1bb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1bad expref: 12 pid: 6512 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349742.534198:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783349742.534200:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349742.534204:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349742.534206:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001659cea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:3648:x1869977659380224:12345-0@lo:103: 00010000:00010000:2.0:1783349742.534215:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349742.534218:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008050370b/0xd05e6ae1590e1bb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1bad expref: 12 pid: 6512 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.534226:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008050370b/0xd05e6ae1590e1bb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1bad expref: 12 pid: 6512 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.534235:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349742.534280:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001659cea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:3648:x1869977659380224:12345-0@lo:103: Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.534286:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349742.534320:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006c039a03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659380096:0@lo:103: 00000100:00100000:3.0:1783349742.534498:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000052ea8044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659380224:0@lo:103: 00010000:00010000:0.0:1783349742.534553:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008050370b/0xd05e6ae1590e1bb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1bad expref: 11 pid: 6512 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349742.534560:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004f32bc8a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659379840:0@lo:104: 00000100:00100000:1.0:1783349742.535176:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783349742.535273:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783349742.535282:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a2cb5d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659379968:12345-0@lo:104: 00010000:00010000:1.0:1783349742.535292:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349742.535353:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783349742.535359:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a2cb5d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659379968:12345-0@lo:104: Request processed in 80us (3159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.535365:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349742.535368:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006044ad21 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659379968:0@lo:104: 00010000:00010000:0.0:1783349742.535395:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535442:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349742.535446:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535453:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fc0d75b already unused, calling callback (00000000a50e4db4) 10000000:00010000:2.0:1783349742.535456:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535462:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349742.535468:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349742.535473:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349742.535504:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535509:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349742.535527:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535533:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1b91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1b98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535547:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349742.535548:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349742.535549:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349742.535554:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006c039a03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659380352:0@lo:103: 00000100:00100000:3.0:1783349742.535592:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349742.535644:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659380352 00000100:00100000:2.0:1783349742.535650:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659380352 00010000:00010000:2.0:1783349742.535665:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1b98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1b91 expref: 11 pid: 6511 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349742.535699:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349742.535704:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052ea8044 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:3649:x1869977659380352:12345-0@lo:103: 00010000:00010000:2.0:1783349742.535712:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349742.535716:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1b98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1b91 expref: 11 pid: 6511 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535723:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1b91 expref: 11 pid: 6511 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535734:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1b98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1b91 expref: 11 pid: 6511 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535744:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535750:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535761:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535778:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535784:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535789:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535801:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008a95587b already unused, calling callback (00000000c7f91d1d) 00010000:00010000:2.0:1783349742.535804:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535809:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535823:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.535830:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349742.535864:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052ea8044 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:3649:x1869977659380352:12345-0@lo:103: Request processed in 160us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.535869:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783349742.535912:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.535919:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.535924:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1c63 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349742.535929:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006c039a03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659380352:0@lo:103: 20000000:01000000:0.0:1783349742.535943:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1783349742.549598:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002271f6f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:7446:x1869977659379584:12345-0@lo:253: Request processed in 34458us (34796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349742.549613:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783349742.549971:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659379584:0@lo:253: 10000000:01000000:3.0:1783349742.549987:0:7446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1783349742.549990:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783349742.549992:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783349742.549993:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349742.549994:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1783349742.549996:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349742.549997:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349742.549998:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783349742.549999:0:7446:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783349742.550001:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349742.550002:0:7446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783349742.550023:0:7446:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000551d221 from lustre-MDT0001 10000000:01000000:3.0:1783349742.550055:0:7446:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1783349742.550057:0:7446:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783349742.550064:0:7446:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ea349f8b380 local copy 10000000:01000000:3.0:1783349742.550068:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783349742.550101:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.550111:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.550120:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.550181:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659380480:0@lo:101: 00000100:00100000:3.0:1783349742.550234:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.550567:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f796868e going to sleep for 11 seconds 00000100:00100000:1.0:1783349742.550631:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659380480 00000100:00100000:1.0:1783349742.550638:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659380480 00000100:00100000:1.0:1783349742.550688:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783349742.550697:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000052c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:7446:x1869977659380480:12345-0@lo:101: 00010000:00010000:1.0:1783349742.550710:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349742.550724:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1c6a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349742.550750:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c6a expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349742.550761:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c6a expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349742.550779:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a02702e, rc 0) 00000100:00100000:1.0:1783349742.550825:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000052c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:7446:x1869977659380480:12345-0@lo:101: Request processed in 130us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.550832:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783349742.550945:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659380480:0@lo:101: 00010000:00010000:3.0:1783349742.550956:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.550964:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.551046:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659380608:0@lo:501: 00000100:00100000:3.0:1783349742.551071:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.551121:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f796868e going to sleep for 11 seconds 00000100:00100000:0.0:1783349742.551672:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659380608 00000100:00100000:0.0:1783349742.551678:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659380608 00000100:00100000:0.0:1783349742.551708:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783349742.551714:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b6a282f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:7446:x1869977659380608:12345-0@lo:501: 00000100:00100000:0.0:1783349742.551925:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b6a282f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:7446:x1869977659380608:12345-0@lo:501: Request processed in 211us (853us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349742.551933:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783349742.551989:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659380608:0@lo:501: 10000000:01000000:3.0:1783349742.552002:0:7446:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783349742.552022:0:7446:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783349742.552026:0:7446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.552034:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.552040:0:7446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.552097:0:7446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783349742.552133:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea357ed9800 10000000:01000000:3.0:1783349742.552153:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783349742.552158:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ea349f8b380 10000000:01000000:3.0:1783349742.552160:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783349742.552163:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8ea349f8b380 from 1 10000000:01000000:3.0:1783349742.552166:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783349742.552187:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000cbef6e6c/0xd05e6ae1590e1c78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.552194:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000cbef6e6c/0xd05e6ae1590e1c78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.552201:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000cbef6e6c/0xd05e6ae1590e1c78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.552215:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659380736:0@lo:101: 00000100:00100000:3.0:1783349742.552241:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.552272:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a8b49502 going to sleep for 11 seconds 00010000:00010000:0.0:1783349742.552372:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349742.552377:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.552385:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068247206 already unused, calling callback (00000000a50e4db4) 10000000:00010000:0.0:1783349742.552387:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.552403:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349742.552409:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349742.552414:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783349742.552430:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.552437:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783349742.552449:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659380736 00000100:00100000:1.0:1783349742.552453:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659380736 00000100:00100000:2.0:1783349742.552483:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006044ad21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659380864:0@lo:103: 00000100:00100000:2.0:1783349742.552520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349742.552567:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.552574:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1c6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd05e6ae1590e1c71 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.552591:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349742.552593:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349742.552594:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349742.552736:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659380864 00000100:00100000:2.0:1783349742.552740:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659380864 00000100:00100000:2.0:1783349742.552899:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349742.552899:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349742.552907:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f64effea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:3646:x1869977659380864:12345-0@lo:103: 00000100:00100000:1.0:1783349742.552907:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000741afdb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:7446:x1869977659380736:12345-0@lo:101: 00010000:00010000:1.0:1783349742.552917:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349742.552920:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349742.552928:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1c7f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1c78 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.552931:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1c71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e1c6a expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.552945:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349742.552945:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1c7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c78 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349742.552953:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a7dbfca/0xd05e6ae1590e1c7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c78 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349742.552959:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a7dbfca, rc 0) 00000100:00100000:2.0:1783349742.552972:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f64effea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:3646:x1869977659380864:12345-0@lo:103: Request processed in 68us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.552979:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349742.552988:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000741afdb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:7446:x1869977659380736:12345-0@lo:101: Request processed in 84us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.552993:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349742.553058:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006044ad21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659380864:0@lo:103: 00000100:00100000:3.0:1783349742.553940:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659380736:0@lo:101: 00010000:00010000:3.0:1783349742.553959:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000cbef6e6c/0xd05e6ae1590e1c78 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c7f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.553968:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000cbef6e6c/0xd05e6ae1590e1c78 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1c7f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349742.553986:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783349742.554039:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000cbef6e6c/0xd05e6ae1590e1c78 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c7f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.554047:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000cbef6e6c/0xd05e6ae1590e1c78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c7f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349742.554066:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ea357ed9800 10000000:01000000:3.0:1783349742.554070:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783349742.554075:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8ea357ed9800 from 1 10000000:01000000:3.0:1783349742.554077:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783349742.554099:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000b9e2d615/0xd05e6ae1590e1c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.554116:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000b9e2d615/0xd05e6ae1590e1c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.554124:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000b9e2d615/0xd05e6ae1590e1c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.554159:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659380992:0@lo:101: 00000100:00100000:3.0:1783349742.554216:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.554248:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a8b49502 going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.554352:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659380992 00000100:00100000:2.0:1783349742.554431:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659380992 00000100:00100000:2.0:1783349742.554524:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783349742.554532:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000795a5bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:7446:x1869977659380992:12345-0@lo:101: 00010000:00010000:2.0:1783349742.554544:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349742.554556:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f658a6d/0xd05e6ae1590e1c8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1c86 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.554577:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f658a6d/0xd05e6ae1590e1c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c86 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.554587:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f658a6d/0xd05e6ae1590e1c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c86 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.554595:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f658a6d, rc 0) 00000100:00100000:2.0:1783349742.554636:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000795a5bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:7446:x1869977659380992:12345-0@lo:101: Request processed in 105us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.554642:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783349742.554892:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659380992:0@lo:101: 00010000:00010000:3.0:1783349742.555024:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000b9e2d615/0xd05e6ae1590e1c86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.555033:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000b9e2d615/0xd05e6ae1590e1c86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349742.555045:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783349742.555085:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000b9e2d615/0xd05e6ae1590e1c86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.555093:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000b9e2d615/0xd05e6ae1590e1c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349742.555118:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783349742.555122:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783349742.555127:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ea357ed9800 10000000:01000000:3.0:1783349742.555129:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783349742.555131:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1783349742.555153:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783349742.555173:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000991ec4a0/0xd05e6ae1590e1c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.555179:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000991ec4a0/0xd05e6ae1590e1c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.555185:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000991ec4a0/0xd05e6ae1590e1c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.555206:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659381120:0@lo:101: 00000100:00100000:3.0:1783349742.555234:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.555256:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a8b49502 going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.555381:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659381120 00000100:00100000:2.0:1783349742.555386:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659381120 00000100:00100000:2.0:1783349742.555413:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349742.555418:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010bdf5ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:7446:x1869977659381120:12345-0@lo:101: 00010000:00010000:2.0:1783349742.555426:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349742.555436:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca113699/0xd05e6ae1590e1c9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1c94 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.555450:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca113699/0xd05e6ae1590e1c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c94 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.555470:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca113699/0xd05e6ae1590e1c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c94 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.555476:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca113699, rc 0) 00000100:00100000:2.0:1783349742.555503:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010bdf5ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659381120:12345-0@lo:101: Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.555509:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783349742.555616:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659381120:0@lo:101: 00010000:00010000:3.0:1783349742.555625:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000991ec4a0/0xd05e6ae1590e1c94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.555631:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000991ec4a0/0xd05e6ae1590e1c94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.555718:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659381248:0@lo:501: 00000100:00100000:3.0:1783349742.555741:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.555811:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a8b49502 going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.555983:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659381248 00000100:00100000:2.0:1783349742.555987:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659381248 00000100:00100000:2.0:1783349742.556048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783349742.556055:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb68a4b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659381248:12345-0@lo:501: 00000100:00100000:2.0:1783349742.556311:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb68a4b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659381248:12345-0@lo:501: Request processed in 256us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.556318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783349742.556378:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025e5fdab pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659381248:0@lo:501: 00000100:00100000:0.0:1783349742.556407:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004f32bc8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659381376:0@lo:503: 00000100:00100000:0.0:1783349742.556447:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349742.556472:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000dfe879b2 going to sleep for 11 seconds 00000100:00100000:1.0:1783349742.556486:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659381376 00000100:00100000:1.0:1783349742.556490:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659381376 00000100:00100000:1.0:1783349742.556511:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783349742.556516:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e17323c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659381376:12345-0@lo:503: 00000100:00100000:1.0:1783349742.556634:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e17323c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659381376:12345-0@lo:503: Request processed in 117us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.556640:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783349742.556851:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004f32bc8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659381376:0@lo:503: 00000040:00080000:0.0:1783349742.557085:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783349742.557343:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004f32bc8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659381504:0@lo:502: 00000100:00100000:0.0:1783349742.557393:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349742.557454:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000dfe879b2 going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.557491:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659381504 00000100:00100000:2.0:1783349742.557496:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659381504 00000100:00100000:2.0:1783349742.557530:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783349742.557537:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9690952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659381504:12345-0@lo:502: 00000100:00100000:2.0:1783349742.557668:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9690952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659381504:12345-0@lo:502: Request processed in 132us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.557676:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783349742.557859:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004f32bc8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659381504:0@lo:502: 00000040:00080000:0.0:1783349742.558063:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783349742.558089:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1783349742.558115:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1783349742.558131:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1783349742.558288:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1783349742.558305:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1783349742.558320:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1783349742.558331:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1783349742.558343:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1783349742.558354:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1783349742.558367:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1783349742.558381:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1783349742.558395:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1783349742.558408:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1783349742.558423:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1783349742.558435:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1783349742.558447:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1783349742.558461:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1783349742.558476:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1783349742.558490:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1783349742.558501:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1783349742.558515:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1783349742.558528:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1783349742.558553:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004f32bc8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659381632:0@lo:502: 00000100:00100000:0.0:1783349742.558595:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349742.558627:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 00000000dfe879b2 going to sleep for 11 seconds 00000100:00100000:1.0:1783349742.558817:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659381632 00000100:00100000:1.0:1783349742.558824:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659381632 00000100:00100000:1.0:1783349742.558913:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783349742.558931:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011d938db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659381632:12345-0@lo:502: 00000100:00100000:1.0:1783349742.559032:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011d938db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659381632:12345-0@lo:502: Request processed in 112us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.559038:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783349742.559108:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004f32bc8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659381632:0@lo:502: 00000040:00080000:0.0:1783349742.559164:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1783349742.559172:0:7446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1783349742.559692:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349742.559703:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349742.559705:0:7460:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783349742.559709:0:7460:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1783349742.559711:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783349742.559722:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000fd91727d) 00000020:00000080:0.0:1783349742.559736:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1783349742.559739:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783349742.559844:0:7460:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783349742.559853:0:7460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e1ca9 00000020:00000080:0.0:1783349742.560085:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1783349742.560090:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349742.560093:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349742.560094:0:7460:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783349742.560096:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349742.560099:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349742.560101:0:7460:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1783349742.560104:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783349742.560110:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000030d5cc0c) 00000020:00000080:0.0:1783349742.560120:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1783349742.560123:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783349742.560125:0:7460:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1783349742.560128:0:7460:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1783349742.560352:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783349742.560411:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000551d221 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1783349742.560431:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000056c90375) 00000020:00000080:0.0:1783349742.560440:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1783349742.560505:0:7460:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783349742.560509:0:7460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e1cbe 00000020:00000080:0.0:1783349742.560599:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1783349742.560616:0:7460:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783349742.560620:0:7460:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd05e6ae1590e1cc5 00080000:01000000:0.0:1783349742.560625:0:7460:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783349742.560627:0:7460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e1ccc 00080000:10000000:0.0:1783349742.561386:0:7460:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1783349742.561513:0:7460:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1783349742.626964:0:7460:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1783349742.627364:0:7460:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1783349742.629977:0:7460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1783349742.630514:0:7460:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783349742.646807:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1783349742.646823:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349742.646830:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349742.646833:0:7460:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1783349742.646837:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349742.646844:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349742.646846:0:7460:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1783349742.646849:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783349742.646854:0:7460:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:00000080:1.0:1783349742.646884:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783349742.646901:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000a226c987) 00000020:00000080:1.0:1783349742.646931:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1783349742.646937:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783349742.647049:0:7460:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1783349742.647056:0:7460:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783349742.647063:0:7460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e1cda 00010000:00080000:1.0:1783349742.647096:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000abebae9f@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783349742.648725:0:7460:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1783349742.649726:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783349742.649741:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783349742.649835:0:7460:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783349742.649855:0:7460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e1ce1 00000100:00080000:0.0:1783349742.649866:0:7460:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783349742.649870:0:7460:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000abebae9f using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349742.649907:0:7460:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004f32bc8a x1869977659381760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783349742.649963:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004f32bc8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659381760:0@lo:38: 00000100:00100000:1.0:1783349742.650048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783349742.650129:0:7460:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783349742.650168:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659381760 00000100:00100000:2.0:1783349742.650176:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659381760 00000100:00100000:2.0:1783349742.650214:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349742.650220:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f916573c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869977659381760:12345-0@lo:38: 00000020:01000000:0.0:1783349742.650228:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349742.650233:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349742.650235:0:7460:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1783349742.650237:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783349742.650240:0:7460:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1783349742.650242:0:7460:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783349742.650243:0:7460:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00010000:00080000:2.0:1783349742.650246:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:01000000:0.0:1783349742.650247:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783349742.650250:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349742.650251:0:7460:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783349742.650257:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349742.650263:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349742.650264:0:7460:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1783349742.650270:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:00000080:2.0:1783349742.650302:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e1ce8 00000004:01000000:0.0:1783349742.650312:0:7460:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000004:00100000:2.0:1783349742.650320:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:0.0:1783349742.650326:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000001:00000004:2.0:1783349742.650329:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:00000080:0.0:1783349742.650337:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349742.650339:0:7460:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1783349742.650342:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349742.650346:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349742.650347:0:7460:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783349742.650351:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783349742.650352:0:7460:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783349742.650375:0:7460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349742.650378:0:7460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349742.650380:0:7460:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783349742.650383:0:7460:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1783349742.650600:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1783349742.650634:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783349742.650657:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000991ec4a0/0xd05e6ae1590e1c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.650667:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000991ec4a0/0xd05e6ae1590e1c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349742.650675:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea357ed9800 from 1 10000000:01000000:3.0:1783349742.650678:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783349742.650700:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.650708:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.650715:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.650729:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005812344b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382016:0@lo:101: 00000100:00100000:3.0:1783349742.650795:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.650828:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000067763f34 going to sleep for 11 seconds 00000100:00100000:0.0:1783349742.650952:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659382016 00000100:00100000:0.0:1783349742.650957:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659382016 00000100:00100000:0.0:1783349742.651002:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783349742.651010:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c944b5a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:7446:x1869977659382016:12345-0@lo:101: 00010000:00010000:0.0:1783349742.651023:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349742.651033:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1cf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1cef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.651055:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1cef expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.651065:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1cef expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349742.651073:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a95587b, rc 0) 00000100:00100000:2.0:1783349742.651171:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c01d88f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659381888:0@lo:400: 00000100:00100000:0.0:1783349742.651232:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c944b5a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:7446:x1869977659382016:12345-0@lo:101: Request processed in 222us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349742.651239:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783349742.651286:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.651443:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005812344b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382016:0@lo:101: 00010000:00010000:3.0:1783349742.651458:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.651472:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349742.651494:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659381888 00000100:00100000:0.0:1783349742.651499:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659381888 00000100:00100000:0.0:1783349742.651533:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783349742.651540:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef3afe65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659381888:12345-0@lo:400: 00000100:00100000:0.0:1783349742.651584:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef3afe65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659381888:12345-0@lo:400: Request processed in 45us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349742.651591:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349742.652062:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005812344b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382144:0@lo:256: 00000100:00100000:3.0:1783349742.652105:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.652163:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000067763f34 going to sleep for 11 seconds 00000100:00100000:0.0:1783349742.652173:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659382144 00000100:00100000:0.0:1783349742.652188:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659382144 00000100:00100000:0.0:1783349742.652219:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783349742.652226:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054f3cc70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:7446:x1869977659382144:12345-0@lo:256: 20000000:01000000:0.0:1783349742.652243:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783349742.652259:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783349742.652263:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1783349742.652368:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054f3cc70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:7446:x1869977659382144:12345-0@lo:256: Request processed in 142us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349742.652376:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783349742.652384:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005812344b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382144:0@lo:256: 00010000:00080000:2.0:1783349742.653225:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c01d88f4 x1869977659381888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349742.653243:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c01d88f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659381888:0@lo:400: 10000000:01000000:3.0:1783349742.653664:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783349742.653682:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.653692:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349742.653700:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea357ed9800 from 1 10000000:01000000:3.0:1783349742.653703:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349742.653736:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.653743:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.653751:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.655375:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005812344b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382272:0@lo:101: 00000100:00100000:3.0:1783349742.655708:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.655820:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000067763f34 going to sleep for 11 seconds 00000100:00100000:1.0:1783349742.655869:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659382272 00000100:00100000:1.0:1783349742.655877:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659382272 00000100:00100000:1.0:1783349742.655979:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783349742.655988:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aaaf2e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:7446:x1869977659382272:12345-0@lo:101: 00010000:00010000:1.0:1783349742.656003:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349742.656019:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000005200d70/0xd05e6ae1590e1d04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1cfd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349742.656052:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005200d70/0xd05e6ae1590e1d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1cfd expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349742.656062:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000005200d70/0xd05e6ae1590e1d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1cfd expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349742.656070:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000005200d70, rc 0) 00000100:00100000:1.0:1783349742.656121:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aaaf2e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:7446:x1869977659382272:12345-0@lo:101: Request processed in 134us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.656128:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783349742.656239:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005812344b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382272:0@lo:101: 00010000:00010000:3.0:1783349742.656256:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.656264:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.656370:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005812344b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382400:0@lo:501: 00000100:00100000:3.0:1783349742.656397:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.656723:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000067763f34 going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.656775:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659382400 00000100:00100000:2.0:1783349742.656780:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659382400 00000100:00100000:2.0:1783349742.656808:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349742.656814:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053f52a52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:7446:x1869977659382400:12345-0@lo:501: 00000100:00100000:2.0:1783349742.656908:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053f52a52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:7446:x1869977659382400:12345-0@lo:501: Request processed in 94us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.656915:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783349742.657100:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005812344b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382400:0@lo:501: 00000100:00100000:3.0:1783349742.657728:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005812344b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382528:0@lo:503: 00000100:00100000:3.0:1783349742.657792:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.658615:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000067763f34 going to sleep for 11 seconds 00000100:00100000:1.0:1783349742.659711:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659382528 00000100:00100000:1.0:1783349742.659725:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659382528 00000100:00100000:1.0:1783349742.659791:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783349742.659800:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfef0f07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:7446:x1869977659382528:12345-0@lo:503: 00000040:00080000:1.0:1783349742.659866:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783349742.659961:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfef0f07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:7446:x1869977659382528:12345-0@lo:503: Request processed in 154us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.659969:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783349742.660198:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005812344b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382528:0@lo:503: 00000040:00080000:0.0:1783349742.660465:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349742.660511:0:7446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1783349742.660583:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349742.666369:0:7465:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00080000:2.0:1783349742.666931:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000688d3938 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783349742.667496:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f916573c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869977659381760:12345-0@lo:38: Request processed in 17272us (17446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.667509:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1783349742.667540:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1783349742.667581:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00000100:00100000:1.0:1783349742.667595:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00010000:00010000:3.0:1783349742.667604:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783349742.667604:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783349742.667611:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783349742.667617:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00010000:00010000:3.0:1783349742.667618:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783349742.667622:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000abebae9f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783349742.667672:0:7446:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783349742.667676:0:7446:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea357ed9800 10000000:01000000:3.0:1783349742.667679:0:7446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea357ed9800 10000000:01000000:3.0:1783349742.667683:0:7446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783349742.667688:0:7446:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea357ed9800 from 1 10000000:01000000:3.0:1783349742.667698:0:7446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:1.0:1783349742.667710:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004f32bc8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659381760:0@lo:38: 00010000:00010000:3.0:1783349742.667729:0:7446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 000000008050370b/0xd05e6ae1590e1d0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.667738:0:7446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 000000008050370b/0xd05e6ae1590e1d0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.667746:0:7446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 000000008050370b/0xd05e6ae1590e1d0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.667782:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382656:0@lo:101: 00000100:00100000:1.0:1783349742.667805:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e6246c01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659382784:0@lo:41: 00000100:00100000:3.0:1783349742.667827:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349742.667840:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.667882:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 000000007ecf7c05 going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.667931:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659382656 00000100:00100000:2.0:1783349742.667947:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659382656 00000100:00100000:2.0:1783349742.667987:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349742.667995:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069e15740 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:7446:x1869977659382656:12345-0@lo:101: 00010000:00010000:2.0:1783349742.668005:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349742.668016:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006699469c/0xd05e6ae1590e1d12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1d0b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.668057:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006699469c/0xd05e6ae1590e1d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d0b expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.668066:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006699469c/0xd05e6ae1590e1d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d0b expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.668074:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006699469c, rc 0) 00000100:00100000:2.0:1783349742.668098:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069e15740 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659382656:12345-0@lo:101: Request processed in 105us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.668104:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349742.668130:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659382784 00000100:00100000:2.0:1783349742.668133:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659382784 00000100:00100000:2.0:1783349742.668171:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349742.668176:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057184f45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1869977659382784:12345-0@lo:41: 00000004:00000024:2.0:1783349742.668198:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1783349742.668288:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382656:0@lo:101: 00010000:00010000:3.0:1783349742.668301:0:7446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 000000008050370b/0xd05e6ae1590e1d0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.668308:0:7446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 000000008050370b/0xd05e6ae1590e1d0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.668380:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382912:0@lo:501: 00000100:00100000:3.0:1783349742.668405:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.668423:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 000000007ecf7c05 going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.668664:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057184f45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1869977659382784:12345-0@lo:41: Request processed in 487us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.668670:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349742.668725:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e6246c01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659382784:0@lo:41: 00000100:00100000:1.0:1783349742.668745:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659382912 00000100:00100000:1.0:1783349742.668748:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659382912 00000100:00100000:1.0:1783349742.668816:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783349742.668822:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e6867a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659382912:12345-0@lo:501: 00000100:00100000:1.0:1783349742.668932:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e6867a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659382912:12345-0@lo:501: Request processed in 110us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349742.670591:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659382912:0@lo:501: 00000100:00100000:3.0:1783349742.670651:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659383040:0@lo:503: 00000100:00100000:3.0:1783349742.670722:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349742.670789:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783349742.671325:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 000000007ecf7c05 going to sleep for 11 seconds 00000100:00100000:1.0:1783349742.671433:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659383040 00000100:00100000:1.0:1783349742.671439:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659383040 00000100:00100000:1.0:1783349742.671469:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783349742.671474:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0a4a142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659383040:12345-0@lo:503: 00000100:00100000:1.0:1783349742.671591:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0a4a142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659383040:12345-0@lo:503: Request processed in 117us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.671599:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783349742.671673:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659383040:0@lo:503: 00000040:00080000:3.0:1783349742.671985:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783349742.672079:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659383168:0@lo:502: 00000100:00100000:3.0:1783349742.672116:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.672198:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 000000007ecf7c05 going to sleep for 11 seconds 00000100:00100000:1.0:1783349742.672403:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659383168 00000100:00100000:1.0:1783349742.672408:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659383168 00000100:00100000:1.0:1783349742.672430:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783349742.672437:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054904e87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659383168:12345-0@lo:502: 00000100:00100000:1.0:1783349742.672511:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054904e87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659383168:12345-0@lo:502: Request processed in 75us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.672519:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783349742.674045:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659383168:0@lo:502: 00000040:00080000:3.0:1783349742.674357:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783349742.674391:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783349742.674404:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783349742.674416:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783349742.674427:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783349742.674438:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783349742.674449:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783349742.674460:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783349742.674472:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783349742.674483:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783349742.674495:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783349742.674506:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783349742.674518:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783349742.674529:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783349742.674539:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783349742.674553:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783349742.674564:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783349742.674576:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783349742.674603:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783349742.674617:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783349742.674628:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783349742.674638:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783349742.674650:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783349742.674662:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783349742.674674:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783349742.674697:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783349742.674710:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783349742.674723:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1783349742.674754:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659383296:0@lo:502: 00000100:00100000:3.0:1783349742.674836:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.674870:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 000000007ecf7c05 going to sleep for 11 seconds 00000100:00100000:1.0:1783349742.677404:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659383296 00000100:00100000:1.0:1783349742.677417:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659383296 00000100:00100000:1.0:1783349742.677482:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783349742.677489:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d89b0e0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659383296:12345-0@lo:502: 00000100:00100000:1.0:1783349742.677648:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d89b0e0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659383296:12345-0@lo:502: Request processed in 159us (2813us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.677662:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783349742.677813:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659383296:0@lo:502: 00000040:00080000:3.0:1783349742.677888:0:7446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783349742.677901:0:7446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1783349742.678436:0:7466:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1783349742.678453:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000003d51c777) 00000020:00000080:1.0:1783349742.678476:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1783349742.678666:0:7466:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000551d221 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783349742.678671:0:7466:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000551d221 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783349742.678673:0:7466:0:(obd_mount.c:701:lustre_put_lsi()) put 000000000551d221 3 00010000:00080000:1.0:1783349742.678702:0:7466:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cf609c6c@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783349742.680225:0:7466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1783349742.680316:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1783349742.680357:0:7466:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783349742.680368:0:7466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd05e6ae1590e1d20 00000100:00080000:1.0:1783349742.680377:0:7466:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783349742.680381:0:7466:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000cf609c6c using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783349742.680413:0:7466:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dcc64373 x1869977659383424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783349742.680434:0:7466:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783349742.682189:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dcc64373 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659383424:0@lo:38: 00000100:00100000:2.0:1783349742.682273:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1783349742.682505:0:7466:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1783349742.682623:0:7468:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1783349742.683879:0:7446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1783349742.683918:0:7446:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783349742.683936:0:7446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 000000008050370b/0xd05e6ae1590e1d0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.683948:0:7446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 000000008050370b/0xd05e6ae1590e1d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783349742.684015:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783349742.684017:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783349742.684019:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349742.684020:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349742.684021:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349742.684022:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349742.684024:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783349742.684025:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349742.684026:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349742.684028:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349742.684029:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783349742.684033:0:7446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1783349742.684035:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783349742.684036:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783349742.684037:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349742.684038:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349742.684045:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349742.684046:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349742.684046:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783349742.684047:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349742.684048:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349742.684049:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349742.684050:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783349742.684072:0:7446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783349742.684088:0:7446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659383552:0@lo:253: 00000100:00100000:3.0:1783349742.684165:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.684199:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659383552 00000100:00100000:3.0:1783349742.684206:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659383552 00000100:00100000:3.0:1783349742.684248:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783349742.684256:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc1cc54f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659383552:12345-0@lo:253: 20000000:01000000:3.0:1783349742.684282:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783349742.684295:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783349742.684590:0:7446:0:(client.c:2701:ptlrpc_set_wait()) set 0000000041512f11 going to sleep for 11 seconds 00000100:00100000:0.0:1783349742.685236:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659383424 00000100:00100000:0.0:1783349742.685245:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659383424 00000100:00100000:0.0:1783349742.685484:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783349742.685490:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c01d88f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659383424:12345-0@lo:38: 00010000:00080000:0.0:1783349742.685515:0:6518:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:0.0:1783349742.685557:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd05e6ae1590e1d27 00000004:00100000:0.0:1783349742.685571:0:6518:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783349742.685604:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000da8c9d93 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349742.685689:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c01d88f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869977659383424:12345-0@lo:38: Request processed in 198us (3416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349742.685696:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000001:00100000:3.0:1783349742.686228:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1783349742.686265:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783349742.686277:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1783349742.686340:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783349742.686347:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783349742.686368:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.686385:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003bd9d880/0xd05e6ae1590e1c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c47 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.686392:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1cf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1cef expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.686400:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.686446:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1cef expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.686460:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1cf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1cef expref: 15 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.686477:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000640bdc48 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659383680:0@lo:104: 00000100:00100000:3.0:1783349742.686529:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349742.686579:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003bd9d880/0xd05e6ae1590e1c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1c47 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.686587:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003bd9d880/0xd05e6ae1590e1c4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c47 expref: 15 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.686595:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000087612809 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659383808:0@lo:104: 00000100:00100000:3.0:1783349742.686615:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.686644:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set 000000005f2283df going to sleep for 11 seconds 00000100:00100000:3.0:1783349742.686665:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659383680 00000100:00100000:3.0:1783349742.686670:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659383680 00000100:00100000:3.0:1783349742.686694:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659383808 00000100:00100000:3.0:1783349742.686696:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659383808 00000100:00100000:3.0:1783349742.686707:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349742.686712:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093855078 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6533:x1869977659383680:12345-0@lo:104: 00010000:00010000:3.0:1783349742.686723:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1783349742.687956:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dcc64373 x1869977659383424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349742.687969:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783349742.687977:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1783349742.687994:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783349742.687998:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783349742.688001:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000cf609c6c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783349742.688008:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dcc64373 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659383424:0@lo:38: 00010000:00010000:3.0:1783349742.688704:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349742.688713:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093855078 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6533:x1869977659383680:12345-0@lo:104: Request processed in 1999us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349742.688730:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783349742.688735:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc1cc54f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7446:x1869977659383552:12345-0@lo:253: Request processed in 4476us (4567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.688746:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783349742.688924:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349742.688936:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae025f0e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6533:x1869977659383808:12345-0@lo:104: 00010000:00010000:3.0:1783349742.688951:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689066:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783349742.689072:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae025f0e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6533:x1869977659383808:12345-0@lo:104: Request processed in 141us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349742.689079:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783349742.689102:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783349742.689107:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689114:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c7ee4d19 already unused, calling callback (00000000a50e4db4) 10000000:00010000:3.0:1783349742.689118:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689126:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349742.689133:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349742.689155:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349742.689258:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689265:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349742.689293:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689299:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 00000000c7ee4d19/0xd05e6ae1590e1cef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1cf6 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689312:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349742.689314:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689320:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e738fdfa already unused, calling callback (00000000a50e4db4) 10000000:00010000:3.0:1783349742.689322:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689328:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349742.689333:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349742.689338:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349742.689350:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689355:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349742.689365:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689370:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 00000000e738fdfa/0xd05e6ae1590e1c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689386:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349742.689392:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349742.689394:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349742.689402:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349742.689417:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000037bfe43d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659383936:0@lo:103: 00000100:00100000:3.0:1783349742.689456:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.689501:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659383936 00000100:00100000:3.0:1783349742.689508:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659383936 00010000:00010000:3.0:1783349742.689532:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1cf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1cef expref: 15 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.689556:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349742.689561:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d4beded pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3648:x1869977659383936:12345-0@lo:103: 00010000:00010000:3.0:1783349742.689572:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349742.689577:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1cf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1cef expref: 15 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689587:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1cf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1cef expref: 15 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689603:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349742.689693:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349742.689705:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d0cec02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659384064:0@lo:103: 00000100:00100000:3.0:1783349742.689719:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d4beded pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3648:x1869977659383936:12345-0@lo:103: Request processed in 157us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349742.689728:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783349742.689742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349742.689794:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659384064 00000100:00100000:2.0:1783349742.689798:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659384064 00010000:00010000:2.0:1783349742.689812:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003bd9d880/0xd05e6ae1590e1c4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c47 expref: 15 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349742.689835:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783349742.689842:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8daadfc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3646:x1869977659384064:12345-0@lo:103: 00000100:00100000:3.0:1783349742.689844:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000037bfe43d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659383936:0@lo:103: 00010000:00010000:2.0:1783349742.689857:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349742.689862:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003bd9d880/0xd05e6ae1590e1c4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c47 expref: 15 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.689879:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003bd9d880/0xd05e6ae1590e1c4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c47 expref: 15 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.689893:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.689900:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.689902:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a95587b/0xd05e6ae1590e1cf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1cef expref: 15 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.689917:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000640bdc48 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659383680:0@lo:104: 20000000:01000000:2.0:1783349742.689926:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003580928s 00010000:00010000:3.0:1783349742.689931:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003bd9d880/0xd05e6ae1590e1c4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1c47 expref: 14 pid: 6510 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.689932:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.689942:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.689952:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.689953:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000087612809 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659383808:0@lo:104: 00010000:00010000:2.0:1783349742.689965:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.689970:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000092bfac3b already unused, calling callback (00000000c7f91d1d) 00010000:00010000:3.0:1783349742.689972:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.689974:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.689990:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.689998:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349742.690006:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349742.690037:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8daadfc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:3646:x1869977659384064:12345-0@lo:103: Request processed in 196us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.690045:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783349742.690054:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.690062:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349742.690068:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000092bfac3b/0xd05e6ae1590e1d2e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349742.690103:0:7446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7446:1869977659383552:0@lo:253: 00000100:00100000:2.0:1783349742.690113:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d0cec02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659384064:0@lo:103: 10000000:01000000:3.0:1783349742.690114:0:7446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1783349742.690119:0:7446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783349742.690122:0:7446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783349742.690123:0:7446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349742.690125:0:7446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349742.690127:0:7446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349742.690129:0:7446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349742.690130:0:7446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783349742.690132:0:7446:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349742.690153:0:7446:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349742.690155:0:7446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349742.690156:0:7446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783349742.690167:0:7446:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783349742.703300:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1783349742.703500:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783349742.703728:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1783349742.704401:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783349742.704690:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783349742.704901:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1783349742.706942:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1783349742.707381:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1783349742.707609:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1783349742.707781:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1783349742.707983:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1783349742.708217:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000020:00080000:1.0:1783349742.710283:0:7471:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1783349742.710289:0:7471:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783349742.710319:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1783349742.710603:0:7472:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1783349742.710645:0:7472:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7cb2648 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7472:1869977659384192:0@lo:700: 00000100:00100000:1.0:1783349742.710705:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349742.710788:0:7472:0:(client.c:2701:ptlrpc_set_wait()) set 00000000da45ca15 going to sleep for 11 seconds 00000040:01000000:3.0:1783349742.710974:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1783349742.711368:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659384192 00000100:00100000:0.0:1783349742.711375:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659384192 00000100:00100000:0.0:1783349742.711423:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349742.711429:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001032146f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7472:x1869977659384192:12345-0@lo:700: 00000100:00100000:1.0:1783349742.711940:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006ad64f77 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7473:1869977659384320:0@lo:1000: 00000100:00100000:1.0:1783349742.711984:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349742.712013:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 0000000073159fa8 going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.712072:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659384320 00000100:00100000:2.0:1783349742.712080:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659384320 00000100:00100000:2.0:1783349742.712114:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349742.712119:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f276367 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7473:x1869977659384320:12345-0@lo:1000: 00000100:00100000:2.0:1783349742.712209:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f276367 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7473:x1869977659384320:12345-0@lo:1000: Request processed in 90us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.712217:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783349742.712284:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006ad64f77 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7473:1869977659384320:0@lo:1000: 00000040:01000000:1.0:1783349742.712312:0:7473:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1783349742.712330:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006ad64f77 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7473:1869977659384448:0@lo:700: 00000100:00100000:1.0:1783349742.712350:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349742.712371:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 000000001fc8896b going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.712529:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659384448 00000100:00100000:2.0:1783349742.712535:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659384448 00000100:00100000:2.0:1783349742.712563:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349742.712569:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000430fbbd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7473:x1869977659384448:12345-0@lo:700: 00000100:00100000:2.0:1783349742.712610:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000430fbbd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7473:x1869977659384448:12345-0@lo:700: Request processed in 41us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.712616:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349742.712643:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006ad64f77 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7473:1869977659384448:0@lo:700: 00000100:00100000:2.0:1783349742.712679:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000050340efe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7473:1869977659384576:0@lo:900: 00000100:00100000:2.0:1783349742.712701:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349742.712726:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659384576 00000100:00100000:2.0:1783349742.712729:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659384576 00000100:00100000:2.0:1783349742.712759:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349742.712773:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f64effea pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7473:x1869977659384576:12345-0@lo:900: 00000100:00100000:2.0:1783349742.712803:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f64effea pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7473:x1869977659384576:12345-0@lo:900: Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.712809:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349742.712823:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f95b7564 going to sleep for 11 seconds 00010000:00080000:2.0:1783349742.712837:0:7473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000050340efe x1869977659384576/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783349758 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349742.712848:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000050340efe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7473:1869977659384576:0@lo:900: 00000100:00100000:2.0:1783349742.712918:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000050340efe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7473:1869977659384704:0@lo:1000: 00000100:00100000:2.0:1783349742.712941:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349742.712959:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659384704 00000100:00100000:2.0:1783349742.712962:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659384704 00000100:00100000:2.0:1783349742.712978:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349742.712983:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f5bf1e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7473:x1869977659384704:12345-0@lo:1000: 00000100:00100000:2.0:1783349742.713023:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f5bf1e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7473:x1869977659384704:12345-0@lo:1000: Request processed in 39us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.713028:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349742.713046:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 00000000951349de going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.713056:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000050340efe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7473:1869977659384704:0@lo:1000: 00000004:00080000:2.0:1783349742.713088:0:7473:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f95b7564 with version 0 00000020:00100000:2.0:1783349742.713100:0:7473:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783349742.713104:0:7473:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000050340efe x1869977659384960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783349742.713114:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000050340efe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7473:1869977659384960:0@lo:1000: 00000100:00100000:2.0:1783349742.713159:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349742.713176:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659384960 00000100:00100000:2.0:1783349742.713179:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659384960 00000100:00100000:2.0:1783349742.713203:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783349742.713208:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c31bc5d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7473:x1869977659384960:12345-0@lo:1000: 00000100:00100000:2.0:1783349742.713439:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 0000000089fa3996 going to sleep for 11 seconds 00000040:01000000:3.0:1783349742.713558:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1783349742.713667:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783349742.714355:0:7446:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783349742.714364:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1783349742.714621:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783349742.719605:0:7446:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783349742.720449:0:7446:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783349742.720516:0:7446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1783349742.720748:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783349742.720975:0:7446:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000001:00080000:2.0:1783349742.720983:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:1.0:1783349742.721414:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:0.0:1783349742.721932:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1783349742.722070:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1783349742.722584:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1783349742.722707:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1783349742.722867:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1783349742.723058:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000100:00100000:2.0:1783349742.723658:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c31bc5d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7473:x1869977659384960:12345-0@lo:1000: Request processed in 10445us (10518us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783349742.723673:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1783349742.723693:0:7473:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1783349742.723699:0:7473:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783349742.723713:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000050340efe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7473:1869977659384960:0@lo:1000: 00000100:00100000:3.0:1783349742.723801:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7473:1869977659385088:0@lo:1000: 00000100:00100000:3.0:1783349742.723837:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.723881:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 0000000002845650 going to sleep for 11 seconds 00000100:00100000:2.0:1783349742.723929:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659385088 00000100:00100000:2.0:1783349742.723936:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659385088 00000100:00100000:2.0:1783349742.723973:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783349742.723981:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087612809 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7473:x1869977659385088:12345-0@lo:1000: 00000100:00100000:2.0:1783349742.724042:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087612809 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7473:x1869977659385088:12345-0@lo:1000: Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349742.724048:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349742.724111:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7473:1869977659385088:0@lo:1000: 00000040:00080000:3.0:1783349742.724127:0:7473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1783349742.724655:0:7473:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c7632157 with version 1 00000004:00080000:3.0:1783349742.725292:0:7463:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000001e7657e2 version 1 rpc_version 1 00000020:00100000:3.0:1783349742.725317:0:7463:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783349742.725325:0:7463:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000338af6d x1869977659385344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783349742.725355:0:7463:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7463:1869977659385344:0@lo:1000: 00000100:00100000:3.0:1783349742.725400:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349742.725422:0:7463:0:(client.c:2701:ptlrpc_set_wait()) set 0000000008a7025e going to sleep for 11 seconds 00000100:00100000:3.0:1783349742.725446:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659385344 00000100:00100000:3.0:1783349742.725450:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659385344 00000100:00100000:3.0:1783349742.725480:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349742.725486:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000640bdc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7463:x1869977659385344:12345-0@lo:1000: 00100000:10000000:0.0:1783349742.725738:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1783349742.725947:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1783349742.726085:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:1.0:1783349742.726430:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001032146f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7472:x1869977659384192:12345-0@lo:700: Request processed in 14999us (15723us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349742.726446:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783349742.726494:0:7472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c7cb2648 x1869977659384192/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783349758 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349742.726509:0:7472:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7cb2648 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7472:1869977659384192:0@lo:700: 40000000:02000000:1.0:1783349742.726519:0:7472:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1783349742.726754:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1783349742.727459:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1783349742.728317:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1783349742.728459:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1783349742.729681:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1783349742.730180:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1783349742.731447:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000040:00080000:2.0:1783349742.735289:0:7473:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783349742.735366:0:7473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1783349742.736690:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1783349742.737421:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1783349742.737558:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1783349742.737714:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1783349742.737889:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1783349742.738221:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1783349742.738361:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1783349742.738491:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1783349742.738597:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1783349742.738708:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1783349742.738855:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1783349742.738980:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000001:00080000:2.0:1783349742.740070:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1783349742.740242:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000640bdc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7463:x1869977659385344:12345-0@lo:1000: Request processed in 14753us (14839us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783349742.740255:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1783349742.740282:0:7463:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1783349742.740289:0:7463:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783349742.740306:0:7463:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000338af6d pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7463:1869977659385344:0@lo:1000: 00100000:10000000:0.0:1783349742.740709:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783349742.741533:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783349742.741702:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1783349742.742446:0:7446:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1783349742.753015:0:7446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1783349742.754812:0:7472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1783349742.757066:0:7446:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783349742.757108:0:7446:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9d9841c57988 00100000:10000000:0.0:1783349742.757118:0:7446:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1783349742.758047:0:7446:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783349742.758078:0:7446:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783349742.758103:0:7446:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783349742.758117:0:7446:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1783349742.760653:0:7446:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783349742.760881:0:7446:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1783349742.790394:0:7472:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783349742.790473:0:7472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783349742.790477:0:7472:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1783349743.236435:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349744.260399:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783349744.262351:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783349744.262358:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea357ed9800 from 4 10000000:01000000:0.0:1783349744.262362:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783349744.262400:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000fe5d5896/0xd05e6ae1590e1d35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.262417:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000fe5d5896/0xd05e6ae1590e1d35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.262429:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000fe5d5896/0xd05e6ae1590e1d35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349744.262452:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ede92525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659385472:0@lo:101: 00000100:00100000:0.0:1783349744.262511:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349744.262558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659385472 00000100:00100000:0.0:1783349744.262559:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 000000005580b732 going to sleep for 11 seconds 00000100:00100000:2.0:1783349744.262565:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659385472 00000100:00100000:2.0:1783349744.262641:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783349744.262648:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005991aaf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:6514:x1869977659385472:12345-0@lo:101: 00010000:00010000:2.0:1783349744.262660:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349744.262670:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0d6ceff/0xd05e6ae1590e1d3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1d35 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.262688:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0d6ceff/0xd05e6ae1590e1d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d35 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.262695:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0d6ceff/0xd05e6ae1590e1d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d35 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.262701:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0d6ceff, rc 0) 00000100:00100000:2.0:1783349744.262736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005991aaf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659385472:12345-0@lo:101: Request processed in 89us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349744.262740:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783349744.262818:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ede92525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659385472:0@lo:101: 00010000:00010000:0.0:1783349744.262830:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000fe5d5896/0xd05e6ae1590e1d35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.262838:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000fe5d5896/0xd05e6ae1590e1d35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349744.262874:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ede92525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659385600:0@lo:256: 00000100:00100000:0.0:1783349744.262898:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.262917:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 000000005580b732 going to sleep for 11 seconds 00000100:00100000:2.0:1783349744.262968:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659385600 00000100:00100000:2.0:1783349744.262971:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659385600 00000100:00100000:2.0:1783349744.263050:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783349744.263058:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e5fe2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659385600:12345-0@lo:256: 20000000:01000000:2.0:1783349744.263073:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783349744.263088:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783349744.263091:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783349744.263209:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e5fe2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659385600:12345-0@lo:256: Request processed in 152us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349744.263325:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ede92525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659385600:0@lo:256: 10000000:01000000:0.0:1783349744.263426:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783349744.263432:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000fe5d5896/0xd05e6ae1590e1d35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.263440:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000fe5d5896/0xd05e6ae1590e1d35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349744.263456:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783349744.263457:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea3461c1000 from 21 10000000:01000000:0.0:1783349744.263459:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783349744.263475:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 000000003bd9d880/0xd05e6ae1590e1d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.263482:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 000000003bd9d880/0xd05e6ae1590e1d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.263488:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 000000003bd9d880/0xd05e6ae1590e1d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349744.263500:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ede92525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659385728:0@lo:101: 00000100:00100000:0.0:1783349744.263525:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.263546:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 000000005580b732 going to sleep for 11 seconds 00000100:00100000:2.0:1783349744.263578:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783349744.263596:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659385728 00000100:00100000:2.0:1783349744.263599:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659385728 00000100:00100000:2.0:1783349744.263625:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783349744.263630:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2e327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659385728:12345-0@lo:101: 00010000:00010000:2.0:1783349744.263636:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349744.263645:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000381291bb/0xd05e6ae1590e1d4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1d43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.263658:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000381291bb/0xd05e6ae1590e1d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d43 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.263664:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000381291bb/0xd05e6ae1590e1d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d43 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.263669:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000381291bb, rc 0) 00000100:00100000:2.0:1783349744.263694:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2e327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659385728:12345-0@lo:101: Request processed in 65us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349744.263705:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783349744.263733:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ede92525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659385728:0@lo:101: 00010000:00010000:2.0:1783349744.263742:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 000000003bd9d880/0xd05e6ae1590e1d43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.263749:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 000000003bd9d880/0xd05e6ae1590e1d43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.263820:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000088a63be9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659385856:0@lo:501: 00000100:00100000:2.0:1783349744.263844:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349744.263866:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 000000003a9e9cc6 going to sleep for 11 seconds 00000100:00100000:0.0:1783349744.263905:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659385856 00000100:00100000:0.0:1783349744.263912:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659385856 00000100:00100000:1.0:1783349744.263930:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783349744.263937:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096460474 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659385856:12345-0@lo:501: 00000100:00100000:1.0:1783349744.264156:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096460474 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659385856:12345-0@lo:501: Request processed in 198us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.264164:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783349744.264430:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000088a63be9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659385856:0@lo:501: 00000100:00100000:3.0:1783349744.264459:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000037bfe43d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659385984:0@lo:503: 00000100:00100000:3.0:1783349744.264497:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349744.264519:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 0000000085547ca7 going to sleep for 11 seconds 00000100:00100000:3.0:1783349744.264530:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659385984 00000100:00100000:3.0:1783349744.264533:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659385984 00000100:00100000:3.0:1783349744.264556:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783349744.264561:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000181abab1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659385984:12345-0@lo:503: 00000100:00100000:3.0:1783349744.264635:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000181abab1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659385984:12345-0@lo:503: Request processed in 74us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349744.264642:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783349744.264678:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000037bfe43d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659385984:0@lo:503: 00000100:00100000:1.0:1783349744.265915:0:7571:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7cb2648 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7571:1869977659386112:0@lo:502: 00000100:00100000:1.0:1783349744.265980:0:7571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.266020:0:7571:0:(client.c:2701:ptlrpc_set_wait()) set 000000004200cffd going to sleep for 11 seconds 00000100:00100000:3.0:1783349744.266067:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659386112 00000100:00100000:3.0:1783349744.266073:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659386112 00000100:00100000:3.0:1783349744.266124:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783349744.266131:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6a37cdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7571:x1869977659386112:12345-0@lo:502: 00000100:00100000:3.0:1783349744.266273:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6a37cdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7571:x1869977659386112:12345-0@lo:502: Request processed in 142us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349744.266281:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783349744.266416:0:7571:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7cb2648 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7571:1869977659386112:0@lo:502: 00000100:00100000:1.0:1783349744.266458:0:7571:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7cb2648 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7571:1869977659386240:0@lo:502: 00000100:00100000:1.0:1783349744.266489:0:7571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.267594:0:7571:0:(client.c:2701:ptlrpc_set_wait()) set 000000004200cffd going to sleep for 11 seconds 00000100:00100000:3.0:1783349744.267696:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659386240 00000100:00100000:3.0:1783349744.267703:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659386240 00000100:00100000:3.0:1783349744.267764:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783349744.267772:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052da00a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7571:x1869977659386240:12345-0@lo:502: 00000100:00100000:3.0:1783349744.267883:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052da00a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:7571:x1869977659386240:12345-0@lo:502: Request processed in 113us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349744.267891:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783349744.268077:0:7571:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7cb2648 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7571:1869977659386240:0@lo:502: 00000040:00080000:1.0:1783349744.268104:0:7571:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1783349744.269426:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1783349744.269458:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783349744.269468:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 000000003bd9d880/0xd05e6ae1590e1d43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.269478:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 000000003bd9d880/0xd05e6ae1590e1d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349744.269487:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783349744.269489:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea3461c1000 from 4 10000000:01000000:0.0:1783349744.269492:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783349744.269526:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 000000008a95587b/0xd05e6ae1590e1d51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.269540:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 000000008a95587b/0xd05e6ae1590e1d51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.269550:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 000000008a95587b/0xd05e6ae1590e1d51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349744.269569:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659386368:0@lo:101: 00000100:00100000:0.0:1783349744.269619:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.269663:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 000000005580b732 going to sleep for 11 seconds 00000100:00100000:1.0:1783349744.269742:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659386368 00000100:00100000:1.0:1783349744.269747:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659386368 00000100:00100000:1.0:1783349744.269796:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783349744.269805:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000658d2feb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659386368:12345-0@lo:101: 00010000:00010000:1.0:1783349744.269817:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349744.269827:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f63e055f/0xd05e6ae1590e1d58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1d51 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.269846:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f63e055f/0xd05e6ae1590e1d58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d51 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.269856:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f63e055f/0xd05e6ae1590e1d58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d51 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.269863:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f63e055f, rc 0) 00000100:00100000:1.0:1783349744.269907:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000658d2feb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659386368:12345-0@lo:101: Request processed in 104us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.269913:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783349744.270004:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659386368:0@lo:101: 00010000:00010000:0.0:1783349744.270016:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 000000008a95587b/0xd05e6ae1590e1d51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.270023:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 000000008a95587b/0xd05e6ae1590e1d51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349744.270070:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659386496:0@lo:256: 00000100:00100000:0.0:1783349744.270098:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.270119:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 000000005580b732 going to sleep for 11 seconds 00000100:00100000:2.0:1783349744.270300:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659386496 00000100:00100000:2.0:1783349744.270305:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659386496 00000100:00100000:2.0:1783349744.270336:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783349744.270342:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000048a970b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659386496:12345-0@lo:256: 20000000:01000000:2.0:1783349744.270355:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783349744.270370:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783349744.270373:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783349744.270433:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000048a970b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659386496:12345-0@lo:256: Request processed in 92us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349744.270440:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783349744.270528:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659386496:0@lo:256: 10000000:01000000:0.0:1783349744.270570:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783349744.270575:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 000000008a95587b/0xd05e6ae1590e1d51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.270582:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 000000008a95587b/0xd05e6ae1590e1d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349744.270598:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783349744.270600:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1783349744.270602:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783349744.270617:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.270624:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.270631:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349744.270642:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659386624:0@lo:101: 00000100:00100000:0.0:1783349744.270663:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.270689:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 000000005580b732 going to sleep for 11 seconds 00000100:00100000:2.0:1783349744.270728:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659386624 00000100:00100000:2.0:1783349744.270732:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659386624 00000100:00100000:2.0:1783349744.270771:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783349744.270778:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d64a1e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659386624:12345-0@lo:101: 00010000:00010000:2.0:1783349744.270786:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349744.270797:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003afb101a/0xd05e6ae1590e1d66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1d5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.270818:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003afb101a/0xd05e6ae1590e1d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d5f expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.270828:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003afb101a/0xd05e6ae1590e1d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d5f expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.270834:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003afb101a, rc 0) 00000100:00100000:2.0:1783349744.270934:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d64a1e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659386624:12345-0@lo:101: Request processed in 157us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349744.270940:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783349744.271503:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659386624:0@lo:101: 00010000:00010000:1.0:1783349744.271524:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.271532:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.271586:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7cb2648 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659386752:0@lo:501: 00000100:00100000:1.0:1783349744.271618:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.271637:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 0000000073159fa8 going to sleep for 11 seconds 00000100:00100000:0.0:1783349744.272120:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659386752 00000100:00100000:0.0:1783349744.272126:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659386752 00000100:00100000:0.0:1783349744.272183:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783349744.272190:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4bdc118 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659386752:12345-0@lo:501: 00000100:00100000:0.0:1783349744.272323:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4bdc118 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659386752:12345-0@lo:501: Request processed in 134us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349744.272329:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783349744.272365:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7cb2648 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659386752:0@lo:501: 00000100:00100000:0.0:1783349744.272396:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000179e10a0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659386880:0@lo:503: 00000100:00100000:0.0:1783349744.272431:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.272453:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a5f24756 going to sleep for 11 seconds 00000100:00100000:0.0:1783349744.272464:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659386880 00000100:00100000:0.0:1783349744.272472:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659386880 00000100:00100000:0.0:1783349744.272499:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783349744.272504:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb23660b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659386880:12345-0@lo:503: 00000100:00100000:0.0:1783349744.272578:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb23660b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659386880:12345-0@lo:503: Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349744.272584:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783349744.272617:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000179e10a0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659386880:0@lo:503: 00000100:00100000:0.0:1783349744.272787:0:7574:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000179e10a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7574:1869977659387008:0@lo:502: 00000100:00100000:0.0:1783349744.272817:0:7574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.272833:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659387008 00000100:00100000:0.0:1783349744.272836:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659387008 00000100:00100000:0.0:1783349744.272851:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783349744.272856:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000974ce840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:7574:x1869977659387008:12345-0@lo:502: 00000100:00100000:0.0:1783349744.272915:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000974ce840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:7574:x1869977659387008:12345-0@lo:502: Request processed in 59us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349744.272920:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783349744.272948:0:7574:0:(client.c:2701:ptlrpc_set_wait()) set 0000000070d63956 going to sleep for 11 seconds 00000100:00100000:0.0:1783349744.272960:0:7574:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000179e10a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7574:1869977659387008:0@lo:502: 00000020:01000000:0.0:1783349744.272991:0:7574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349744.273003:0:7574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349744.273005:0:7574:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783349744.273010:0:7574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783349744.273013:0:7574:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:00000080:0.0:1783349744.273033:0:7574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783349744.273045:0:7574:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000024b1d92) 00000020:00000080:0.0:1783349744.273064:0:7574:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1783349744.273068:0:7574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783349744.273157:0:7574:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783349744.273162:0:7574:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783349744.273168:0:7574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e1d74 00010000:00080000:0.0:1783349744.273196:0:7574:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000099644c88@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:0.0:1783349744.275308:0:7574:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1783349744.276781:0:7574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783349744.276793:0:7574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783349744.276826:0:7574:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783349744.276845:0:7574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e1d7b 00000100:00080000:1.0:1783349744.276855:0:7574:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783349744.276859:0:7574:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000099644c88 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783349744.276889:0:7574:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000008e12360 x1869977659387136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783349744.276913:0:7574:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783349744.276923:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000008e12360 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659387136:0@lo:38: 00000100:00100000:2.0:1783349744.276987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1783349744.276991:0:7574:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1783349744.277243:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000179e10a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659387264:0@lo:400: 00000100:00100000:1.0:1783349744.277274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349744.277326:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659387136 00000100:00100000:3.0:1783349744.277334:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659387136 00000100:00100000:3.0:1783349744.277363:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783349744.277369:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f404196 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659387136:12345-0@lo:38: 00010000:00080000:3.0:1783349744.277391:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1783349744.277421:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e1d82 00000004:00100000:3.0:1783349744.277434:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783349744.277438:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1783349744.277475:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031925c5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659387520:0@lo:400: 00000100:00100000:3.0:1783349744.277503:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c8180468 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659387392:0@lo:400: 00000100:00100000:0.0:1783349744.277504:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349744.277528:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.277531:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659387264 00000100:00100000:0.0:1783349744.277534:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659387264 00000100:00100000:3.0:1783349744.277551:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1783349744.277558:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1783349744.277560:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659387520 00000100:00100000:0.0:1783349744.277563:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659387520 00000100:00100000:0.0:1783349744.277577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783349744.277583:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089e96468 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659387264:12345-0@lo:400: 00000100:00100000:0.0:1783349744.277749:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089e96468 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659387264:12345-0@lo:400: Request processed in 166us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349744.277769:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783349744.277784:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349744.277789:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9aa2ed2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659387520:12345-0@lo:400: 00000100:00100000:0.0:1783349744.277828:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9aa2ed2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659387520:12345-0@lo:400: Request processed in 39us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349744.277834:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783349744.278009:0:7577:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000a1ecd8ab x1869977659387648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349744.278019:0:7577:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b346052c going to sleep for 0 seconds 00000020:01000000:0.0:1783349744.278075:0:7574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349744.278080:0:7574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349744.278082:0:7574:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1783349744.278084:0:7574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349744.278092:0:7574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349744.278093:0:7574:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783349744.278096:0:7574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783349744.278097:0:7574:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783349744.278115:0:7574:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7574:1869977659387776:0@lo:502: 00010000:00080000:3.0:1783349744.278205:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000031925c5c x1869977659387520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349744.278284:0:7574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349744.278290:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031925c5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659387520:0@lo:400: 00000100:00100000:0.0:1783349744.278307:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659387776 00000100:00100000:0.0:1783349744.278311:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659387776 00000100:00100000:3.0:1783349744.278326:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659387392 00000100:00100000:3.0:1783349744.278329:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659387392 00000100:00100000:0.0:1783349744.278336:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783349744.278341:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042661b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:7574:x1869977659387776:12345-0@lo:502: 00000100:00100000:3.0:1783349744.278406:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349744.278411:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037bfe43d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659387392:12345-0@lo:400: 00000100:00100000:0.0:1783349744.278419:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042661b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:7574:x1869977659387776:12345-0@lo:502: Request processed in 79us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349744.278425:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783349744.278444:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037bfe43d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659387392:12345-0@lo:400: Request processed in 33us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349744.278450:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783349744.278461:0:7574:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c6079894 going to sleep for 11 seconds 00000100:00100000:3.0:1783349744.278471:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c8180468 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659387392:0@lo:400: 00000100:00100000:0.0:1783349744.278471:0:7574:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:7574:1869977659387776:0@lo:502: 00000020:01000000:0.0:1783349744.278488:0:7574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349744.278491:0:7574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349744.278492:0:7574:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783349744.278495:0:7574:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1783349744.278536:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1783349744.278553:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783349744.278561:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.278571:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 000000008fc0d75b/0xd05e6ae1590e1d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349744.278580:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783349744.278582:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ea349f8b380 from 1 10000000:01000000:0.0:1783349744.278588:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783349744.278764:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1d89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.278772:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1d89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.278781:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1d89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349744.278794:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659387904:0@lo:101: 00000100:00100000:0.0:1783349744.278819:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.278846:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c6079894 going to sleep for 11 seconds 00000100:00100000:0.0:1783349744.278862:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659387904 00000100:00100000:0.0:1783349744.278866:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659387904 00000100:00100000:0.0:1783349744.278889:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783349744.278894:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051f0064e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659387904:12345-0@lo:101: 00010000:00010000:0.0:1783349744.278902:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349744.278911:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e53889c/0xd05e6ae1590e1d90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1d89 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.278930:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e53889c/0xd05e6ae1590e1d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d89 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.278939:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e53889c/0xd05e6ae1590e1d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d89 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.278947:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e53889c, rc 0) 00010000:00080000:1.0:1783349744.278960:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000179e10a0 x1869977659387264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349744.278973:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000179e10a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659387264:0@lo:400: 00000100:00100000:0.0:1783349744.278977:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051f0064e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659387904:12345-0@lo:101: Request processed in 81us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349744.278992:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783349744.279030:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659387904:0@lo:101: 00010000:00010000:0.0:1783349744.279041:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1d89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.279048:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1d89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349744.279087:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659388032:0@lo:501: 00000100:00100000:0.0:1783349744.279108:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.279128:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c6079894 going to sleep for 11 seconds 00000100:00100000:3.0:1783349744.279170:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659388032 00000100:00100000:3.0:1783349744.279174:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659388032 00000100:00100000:3.0:1783349744.279205:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783349744.279212:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b45843d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659388032:12345-0@lo:501: 00000100:00100000:3.0:1783349744.279272:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b45843d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659388032:12345-0@lo:501: Request processed in 61us (163us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783349744.279279:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783349744.279296:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d39ca21c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659388032:0@lo:501: 10000000:01000000:0.0:1783349744.279314:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783349744.279318:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1d89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349744.279325:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 000000007caae275/0xd05e6ae1590e1d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783349744.300485:0:6523:0:(import.c:65:import_set_state_nolock()) 0000000026f478a7 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349744.300594:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f404196 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1869977659387136:12345-0@lo:38: Request processed in 23222us (23606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349744.300608:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349744.300802:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783349744.300812:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783349744.300819:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783349744.300824:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783349744.300826:0:3645:0:(import.c:65:import_set_state_nolock()) 0000000099644c88 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783349744.300843:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b346052c): req@00000000a1ecd8ab x1869977659387648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349744.300861:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000008e12360 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659387136:0@lo:38: 00000100:00100000:1.0:1783349744.300961:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783349744.300973:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000009e59dab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659388160:0@lo:41: 00000100:00100000:1.0:1783349744.301031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.301076:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659388160 00000100:00100000:1.0:1783349744.301082:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659388160 00000100:00100000:1.0:1783349744.301128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783349744.301173:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000680cdb28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1869977659388160:12345-0@lo:41: 00000004:00000024:1.0:1783349744.301200:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783349744.301235:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000680cdb28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1869977659388160:12345-0@lo:41: Request processed in 65us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.301242:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783349744.301272:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000009e59dab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659388160:0@lo:41: 00000100:00100000:0.0:1783349744.301667:0:7577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.301731:0:7577:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b346052c going to sleep for 11 seconds 00000100:00100000:1.0:1783349744.301991:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659387648 00000100:00100000:1.0:1783349744.301997:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659387648 00000100:00100000:1.0:1783349744.302071:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783349744.302078:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d39ca21c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7577:x1869977659387648:12345-0@lo:1000: 00000100:00100000:1.0:1783349744.302180:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d39ca21c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7577:x1869977659387648:12345-0@lo:1000: Request processed in 103us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.302187:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783349744.302249:0:7577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659387648:0@lo:1000: 00000040:01000000:0.0:1783349744.302281:0:7577:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783349744.302323:0:7577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659388288:0@lo:1000: 00000100:00100000:0.0:1783349744.302353:0:7577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349744.302820:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659388288 00000100:00100000:2.0:1783349744.302825:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659388288 00000100:00100000:2.0:1783349744.302857:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783349744.302863:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ede92525 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7577:x1869977659388288:12345-0@lo:1000: 00000100:00100000:2.0:1783349744.302958:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ede92525 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7577:x1869977659388288:12345-0@lo:1000: Request processed in 96us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349744.303035:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783349744.303227:0:7577:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b346052c going to sleep for 11 seconds 00000100:00100000:0.0:1783349744.303243:0:7577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659388288:0@lo:1000: 00000100:00100000:0.0:1783349744.303285:0:7577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659388416:0@lo:700: 00000100:00100000:0.0:1783349744.303311:0:7577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.303369:0:7577:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f317b133 going to sleep for 11 seconds 00000100:00100000:2.0:1783349744.303402:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659388416 00000100:00100000:2.0:1783349744.303405:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659388416 00000100:00100000:2.0:1783349744.303727:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349744.303733:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6246c01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7577:x1869977659388416:12345-0@lo:700: 00000100:00100000:2.0:1783349744.303824:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6246c01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7577:x1869977659388416:12345-0@lo:700: Request processed in 91us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349744.303830:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783349744.303891:0:7577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659388416:0@lo:700: 00000100:00100000:0.0:1783349744.304530:0:7577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659388544:0@lo:1000: 00000100:00100000:0.0:1783349744.304574:0:7577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.304602:0:7577:0:(client.c:2701:ptlrpc_set_wait()) set 00000000755e163b going to sleep for 11 seconds 00000100:00100000:1.0:1783349744.304654:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659388544 00000100:00100000:1.0:1783349744.304660:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659388544 00000100:00100000:1.0:1783349744.304695:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349744.304701:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f32bc8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7577:x1869977659388544:12345-0@lo:1000: 00000100:00100000:1.0:1783349744.304769:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f32bc8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7577:x1869977659388544:12345-0@lo:1000: Request processed in 68us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.304775:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783349744.304899:0:7577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659388544:0@lo:1000: 00000004:00080000:0.0:1783349744.304940:0:7577:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000f317b133 with version 0 00000020:00100000:0.0:1783349744.304955:0:7577:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783349744.304961:0:7577:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a1ecd8ab x1869977659388800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349744.304972:0:7577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659388800:0@lo:1000: 00000100:00100000:0.0:1783349744.305058:0:7577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.305077:0:7577:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c6079894 going to sleep for 11 seconds 00000100:00100000:1.0:1783349744.305125:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659388800 00000100:00100000:1.0:1783349744.305129:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659388800 00000100:00100000:1.0:1783349744.305189:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349744.305202:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006044ad21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7577:x1869977659388800:12345-0@lo:1000: 00000001:00080000:3.0:1783349744.318897:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1783349744.318909:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783349744.319261:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006044ad21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7577:x1869977659388800:12345-0@lo:1000: Request processed in 14055us (14198us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783349744.319275:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1783349744.319550:0:7577:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1783349744.319555:0:7577:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783349744.319571:0:7577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659388800:0@lo:1000: 00000100:00100000:3.0:1783349744.319672:0:7577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003fc521a5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659388928:0@lo:1000: 00000100:00100000:3.0:1783349744.319712:0:7577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349744.319750:0:7577:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc0bb574 going to sleep for 11 seconds 00000100:00100000:0.0:1783349744.320768:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659388928 00000100:00100000:0.0:1783349744.320776:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659388928 00000100:00100000:0.0:1783349744.320827:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783349744.320835:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009133f34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7577:x1869977659388928:12345-0@lo:1000: 00000100:00100000:0.0:1783349744.320932:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009133f34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7577:x1869977659388928:12345-0@lo:1000: Request processed in 98us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349744.320940:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783349744.321104:0:7577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003fc521a5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7577:1869977659388928:0@lo:1000: 00000040:00080000:3.0:1783349744.321124:0:7577:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1783349744.321436:0:7577:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000085547ca7 with version 1 00000040:00080000:3.0:1783349744.324265:0:7577:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783349744.324345:0:7577:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783349744.324351:0:7577:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1783349744.326978:0:7575:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000070d63956 version 1 rpc_version 1 00000020:00100000:0.0:1783349744.327133:0:7575:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783349744.328003:0:7575:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008b3cff4d x1869977659389184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349744.328028:0:7575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b3cff4d pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7575:1869977659389184:0@lo:1000: 00000100:00100000:0.0:1783349744.328101:0:7575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349744.328632:0:7575:0:(client.c:2701:ptlrpc_set_wait()) set 00000000045a0342 going to sleep for 11 seconds 00000100:00100000:1.0:1783349744.328858:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659389184 00000100:00100000:1.0:1783349744.328867:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659389184 00000100:00100000:1.0:1783349744.328935:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349744.328945:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bc42efc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7575:x1869977659389184:12345-0@lo:1000: 00000001:00080000:1.0:1783349744.330775:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1783349744.330984:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bc42efc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7575:x1869977659389184:12345-0@lo:1000: Request processed in 2032us (2874us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783349744.330997:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1783349744.331094:0:7575:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1783349744.331099:0:7575:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783349744.331114:0:7575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b3cff4d pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7575:1869977659389184:0@lo:1000: 00010000:00010000:3.0:1783349745.284660:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783349746.229468:0:7724:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783349746.312809:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783349746.999392:0:7776:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783349746.999602:0:7776:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783349747.341150:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349748.102878:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659389312:0@lo:41: 00000100:00100000:1.0:1783349748.102947:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349748.103384:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659389312 00000100:00100000:0.0:1783349748.103393:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659389312 00000100:00100000:0.0:1783349748.103446:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783349748.103455:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009e59dab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659389312:12345-0@lo:41: 00000004:00000024:0.0:1783349748.103490:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1783349748.103551:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009e59dab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659389312:12345-0@lo:41: Request processed in 98us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349748.103559:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349748.103643:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028cc1a69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659389312:0@lo:41: 00010000:00010000:3.0:1783349748.356635:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349749.382168:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349749.636947:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000008e12360 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659389440:0@lo:41: 00000100:00100000:0.0:1783349749.637063:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349749.637260:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659389696:0@lo:400: 00000100:00100000:0.0:1783349749.637281:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c8180468 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659389952:0@lo:400: 00000100:00100000:2.0:1783349749.637308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349749.637347:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349749.637349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349749.637357:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000179e10a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659389824:0@lo:400: 00000100:00100000:0.0:1783349749.637375:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783349749.637384:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b3cff4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659389568:0@lo:400: 00000100:00100000:2.0:1783349749.637392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349749.637427:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349749.637445:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659389696 00000100:00100000:2.0:1783349749.637455:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659389696 00000100:00100000:0.0:1783349749.637468:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659389952 00000100:00100000:0.0:1783349749.637480:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659389952 00000100:00100000:2.0:1783349749.637517:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783349749.637527:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b87fd08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659389696:12345-0@lo:400: 00000100:00100000:1.0:1783349749.637558:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659389440 00000100:00100000:1.0:1783349749.637564:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659389440 00000100:00100000:2.0:1783349749.637596:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b87fd08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659389696:12345-0@lo:400: Request processed in 70us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349749.637598:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659389824 00000100:00100000:1.0:1783349749.637602:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659389824 00000100:00100000:2.0:1783349749.637609:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783349749.637623:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783349749.637632:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028cc1a69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659389440:12345-0@lo:41: 00000100:00100000:2.0:1783349749.637636:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783349749.637646:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031925c5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659389952:12345-0@lo:400: 00000004:00000024:1.0:1783349749.637681:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1783349749.637686:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031925c5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659389952:12345-0@lo:400: Request processed in 40us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349749.637701:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783349749.638367:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028cc1a69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659389440:12345-0@lo:41: Request processed in 733us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349749.638378:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783349749.638399:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783349749.638413:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e148265 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659389824:12345-0@lo:400: 00000100:00100000:1.0:1783349749.638461:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e148265 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659389824:12345-0@lo:400: Request processed in 50us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349749.638467:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783349749.638663:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659389568 00000100:00100000:0.0:1783349749.638669:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659389568 00000100:00100000:0.0:1783349749.638748:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783349749.638755:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f164077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3648:x1869977659389568:12345-0@lo:400: 00000100:00100000:0.0:1783349749.638791:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f164077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3648:x1869977659389568:12345-0@lo:400: Request processed in 37us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349749.638797:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783349749.640791:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000179e10a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659389824:0@lo:400: 00010000:00080000:3.0:1783349749.640828:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a1ecd8ab x1869977659389696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349749.640841:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a1ecd8ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659389696:0@lo:400: 00000100:00100000:2.0:1783349749.640940:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b3cff4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659389568:0@lo:400: 00010000:00080000:2.0:1783349749.640958:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c8180468 x1869977659389952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349749.640968:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c8180468 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659389952:0@lo:400: 00000100:00100000:2.0:1783349749.640991:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000008e12360 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659389440:0@lo:41: 00000020:00000004:1.0:1783349749.781064:0:7877:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783349749.781462:0:7877:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783349750.404545:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783349750.717324:0:7925:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbe7ca1f0 20000000:00000080:1.0:1783349750.717342:0:7925:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ea375f5dc00 uarg=0000000000000000 20000000:01000000:1.0:1783349750.717392:0:7925:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783349750.717399:0:7925:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783349750.717403:0:7925:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783349750.717471:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1783349750.717483:0:7925:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1783349750.728988:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783349750.729308:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783349750.729344:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1783349750.729359:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1783349750.729385:0:7925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783349750.729399:0:7925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349750.729415:0:7925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000029a10864/0xd05e6ae1590e1c16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c0f expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349750.729421:0:7925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000005200d70/0xd05e6ae1590e1d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1cfd expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349750.729427:0:7925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349750.729468:0:7925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000005200d70/0xd05e6ae1590e1d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1cfd expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349750.729485:0:7925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000005200d70/0xd05e6ae1590e1d04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1cfd expref: 17 pid: 6510 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349750.729498:0:7925:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7cb2648 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1869977659390080:0@lo:104: 00000100:00100000:1.0:1783349750.729560:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783349750.729620:0:7925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000029a10864/0xd05e6ae1590e1c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1c0f expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349750.729627:0:7925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000029a10864/0xd05e6ae1590e1c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c0f expref: 17 pid: 6512 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349750.729634:0:7925:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006ad64f77 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1869977659390208:0@lo:104: 00000100:00100000:1.0:1783349750.729650:0:7925:0:(client.c:2701:ptlrpc_set_wait()) set 000000008ab5a6e1 going to sleep for 11 seconds 00000100:00100000:0.0:1783349750.731260:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783349750.731298:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349750.731341:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659390080 00000100:00100000:0.0:1783349750.731349:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659390080 00000100:00100000:0.0:1783349750.731382:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659390208 00000100:00100000:0.0:1783349750.731385:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659390208 00000100:00100000:0.0:1783349750.731398:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349750.731405:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006968c18e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:7925:x1869977659390080:12345-0@lo:104: 00010000:00010000:0.0:1783349750.731420:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731482:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783349750.731487:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006968c18e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:7925:x1869977659390080:12345-0@lo:104: Request processed in 84us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349750.731494:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349750.731525:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783349750.731531:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8180468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:7925:x1869977659390208:12345-0@lo:104: 00010000:00010000:0.0:1783349750.731537:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731585:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783349750.731589:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8180468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:7925:x1869977659390208:12345-0@lo:104: Request processed in 60us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349750.731594:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1783349750.731610:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783349750.731614:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731620:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068247206 already unused, calling callback (00000000a50e4db4) 10000000:00010000:0.0:1783349750.731623:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731629:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349750.731635:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349750.731640:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783349750.731678:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731684:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349750.731698:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731712:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 0000000068247206/0xd05e6ae1590e1cfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d04 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731735:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349750.731738:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731743:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb6ce0c9 already unused, calling callback (00000000a50e4db4) 10000000:00010000:0.0:1783349750.731746:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731751:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349750.731756:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349750.731760:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783349750.731772:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731778:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349750.731790:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731795:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 00000000eb6ce0c9/0xd05e6ae1590e1c0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731806:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349750.731808:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349750.731809:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349750.731821:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349750.731847:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e3d53eb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659390464:0@lo:103: 00000100:00100000:0.0:1783349750.731874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349750.731911:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659390464 00000100:00100000:0.0:1783349750.731914:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659390464 00010000:00010000:0.0:1783349750.731937:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000029a10864/0xd05e6ae1590e1c16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c0f expref: 18 pid: 6512 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349750.731955:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349750.731960:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a2cb5d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3647:x1869977659390464:12345-0@lo:103: 00010000:00010000:0.0:1783349750.731969:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349750.731973:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000029a10864/0xd05e6ae1590e1c16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c0f expref: 18 pid: 6512 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731981:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000029a10864/0xd05e6ae1590e1c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c0f expref: 18 pid: 6512 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349750.731996:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349750.732021:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a2cb5d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3647:x1869977659390464:12345-0@lo:103: Request processed in 61us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349750.732026:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349750.732053:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e3d53eb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659390464:0@lo:103: 00000100:00100000:2.0:1783349750.732119:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349750.732130:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000057fed08e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659390336:0@lo:103: 00000100:00100000:2.0:1783349750.732181:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349750.732206:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659390336 00000100:00100000:2.0:1783349750.732209:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659390336 00010000:00010000:2.0:1783349750.732222:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000005200d70/0xd05e6ae1590e1d04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1cfd expref: 18 pid: 6510 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349750.732241:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349750.732246:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cc8e6df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3648:x1869977659390336:12345-0@lo:103: 00010000:00010000:2.0:1783349750.732252:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349750.732255:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000005200d70/0xd05e6ae1590e1d04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1cfd expref: 18 pid: 6510 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732262:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000005200d70/0xd05e6ae1590e1d04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1cfd expref: 18 pid: 6510 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732271:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732277:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732295:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732301:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732306:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732311:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732316:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a02702e already unused, calling callback (00000000c7f91d1d) 00010000:00010000:2.0:1783349750.732318:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732324:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732330:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349750.732338:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349750.732361:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cc8e6df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3648:x1869977659390336:12345-0@lo:103: Request processed in 116us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349750.732367:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349750.732394:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000057fed08e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659390336:0@lo:103: 00010000:00010000:3.0:1783349750.733049:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349750.733357:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005200d70/0xd05e6ae1590e1d04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1cfd expref: 17 pid: 6510 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349750.733384:0:7925:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7cb2648 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1869977659390080:0@lo:104: 00010000:00010000:1.0:1783349750.733396:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000029a10864/0xd05e6ae1590e1c16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1c0f expref: 16 pid: 6512 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349750.733403:0:7925:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006ad64f77 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1869977659390208:0@lo:104: 00010000:00010000:1.0:1783349750.733421:0:7925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349750.733429:0:7925:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349750.733445:0:7925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349750.733459:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a02702e/0xd05e6ae1590e1d97 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349751.429356:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349752.452624:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783349753.220363:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349753.220371:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea357ed9800 from 1 10000000:01000000:0.0:1783349753.220375:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349753.220440:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 000000003239b2c4/0xd05e6ae1590e1d9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349753.220454:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 000000003239b2c4/0xd05e6ae1590e1d9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349753.220475:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 000000003239b2c4/0xd05e6ae1590e1d9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349753.220497:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e3d53eb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659390592:0@lo:101: 00000100:00100000:0.0:1783349753.220561:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349753.220605:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ba72d80e going to sleep for 11 seconds 00000100:00100000:3.0:1783349753.220978:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659390592 00000100:00100000:3.0:1783349753.220989:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659390592 00000100:00100000:3.0:1783349753.221051:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783349753.221060:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b461d9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659390592:12345-0@lo:101: 00010000:00010000:3.0:1783349753.221074:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349753.221089:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1da5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1d9e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349753.221111:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d9e expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349753.221122:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e738fdfa/0xd05e6ae1590e1da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d9e expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349753.221131:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e738fdfa, rc 0) 00000100:00100000:3.0:1783349753.221266:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b461d9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659390592:12345-0@lo:101: Request processed in 207us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349753.221280:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783349753.221322:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349753.221333:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b3cff4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659390720:0@lo:41: 00000100:00100000:3.0:1783349753.221363:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349753.221399:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659390720 00000100:00100000:3.0:1783349753.221404:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659390720 00000100:00100000:3.0:1783349753.221442:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783349753.221445:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e3d53eb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659390592:0@lo:101: 00000100:00100000:3.0:1783349753.221452:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fc521a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659390720:12345-0@lo:41: 00010000:00010000:0.0:1783349753.221461:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 000000003239b2c4/0xd05e6ae1590e1d9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349753.221470:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 000000003239b2c4/0xd05e6ae1590e1d9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000024:3.0:1783349753.221481:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1783349753.221522:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fc521a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659390720:12345-0@lo:41: Request processed in 73us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349753.221530:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783349753.221541:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e3d53eb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659390848:0@lo:501: 00000100:00100000:3.0:1783349753.221561:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b3cff4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659390720:0@lo:41: 00000100:00100000:0.0:1783349753.221574:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349753.221590:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659390848 00000100:00100000:3.0:1783349753.221593:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659390848 00000100:00100000:0.0:1783349753.221600:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ba72d80e going to sleep for 11 seconds 00000100:00100000:3.0:1783349753.221617:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783349753.221623:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005de00065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659390848:12345-0@lo:501: 00000100:00100000:3.0:1783349753.225163:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005de00065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659390848:12345-0@lo:501: Request processed in 3532us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349753.225178:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783349753.225262:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e3d53eb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659390848:0@lo:501: 00000100:00100000:3.0:1783349753.225405:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d5fc6acb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659390976:0@lo:503: 00000100:00100000:3.0:1783349753.225459:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349753.225539:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f4ca971a going to sleep for 11 seconds 00000100:00100000:0.0:1783349753.225725:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659390976 00000100:00100000:0.0:1783349753.225732:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659390976 00000100:00100000:0.0:1783349753.225804:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783349753.225813:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d208a7ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659390976:12345-0@lo:503: 00000100:00100000:0.0:1783349753.225945:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d208a7ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659390976:12345-0@lo:503: Request processed in 133us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349753.225952:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783349753.226027:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d5fc6acb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659390976:0@lo:503: 00000100:00100000:1.0:1783349753.228914:0:8055:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006ad64f77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8055:1869977659391104:0@lo:502: 00000100:00100000:1.0:1783349753.228994:0:8055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349753.229069:0:8055:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055e01564 going to sleep for 11 seconds 00000100:00100000:3.0:1783349753.229103:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659391104 00000100:00100000:3.0:1783349753.229115:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659391104 00000100:00100000:3.0:1783349753.229405:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783349753.229414:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1e393c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:8055:x1869977659391104:12345-0@lo:502: 00000100:00100000:3.0:1783349753.229534:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1e393c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:8055:x1869977659391104:12345-0@lo:502: Request processed in 122us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349753.229542:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783349753.229626:0:8055:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006ad64f77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8055:1869977659391104:0@lo:502: 00000020:01000000:1.0:1783349753.229654:0:8055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349753.229663:0:8055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349753.229666:0:8055:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783349753.229672:0:8055:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea357ed9800 00000020:00000080:1.0:1783349753.229674:0:8055:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783349753.229724:0:8055:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8055:1869977659391232:0@lo:502: 00000100:00100000:1.0:1783349753.229758:0:8055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349753.229898:0:8055:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343bc20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349753.229973:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659391232 00000100:00100000:2.0:1783349753.229983:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659391232 00000100:00100000:2.0:1783349753.230007:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783349753.230013:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:8055:x1869977659391232:12345-0@lo:502: 00000100:00100000:2.0:1783349753.230094:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:8055:x1869977659391232:12345-0@lo:502: Request processed in 81us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349753.230101:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783349753.230277:0:8055:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8055:1869977659391232:0@lo:502: 00000020:01000000:1.0:1783349753.230297:0:8055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349753.230302:0:8055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349753.230304:0:8055:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783349753.230308:0:8055:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1783349753.230471:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783349753.230496:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783349753.230506:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e1d9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349753.230518:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e1d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349753.230528:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783349753.230531:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea3461c1000 from 1 10000000:01000000:2.0:1783349753.230533:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783349753.230556:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349753.230565:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349753.230573:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349753.230588:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659391360:0@lo:101: 00000100:00100000:2.0:1783349753.230627:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349753.230654:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea375e269c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349753.230748:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659391360 00000100:00100000:1.0:1783349753.230753:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659391360 00000100:00100000:1.0:1783349753.230775:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783349753.230781:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659391360:12345-0@lo:101: 00010000:00010000:1.0:1783349753.230789:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349753.230799:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea38215ea00/0xd05e6ae1590e1db3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1dac expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349753.230826:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea38215ea00/0xd05e6ae1590e1db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1dac expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349753.230835:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea38215ea00/0xd05e6ae1590e1db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1dac expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349753.230843:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea38215ea00, rc 0) 00000100:00100000:1.0:1783349753.230879:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659391360:12345-0@lo:101: Request processed in 98us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349753.230885:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783349753.230945:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659391360:0@lo:101: 00010000:00010000:2.0:1783349753.230963:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349753.230972:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349753.231015:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659391488:0@lo:501: 00000100:00100000:2.0:1783349753.231039:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349753.231059:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea375e269c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349753.231095:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659391488 00000100:00100000:1.0:1783349753.231099:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659391488 00000100:00100000:1.0:1783349753.231116:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783349753.231122:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659391488:12345-0@lo:501: 00000100:00100000:1.0:1783349753.231243:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659391488:12345-0@lo:501: Request processed in 121us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349753.231251:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783349753.231381:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659391488:0@lo:501: 00000100:00100000:2.0:1783349753.231404:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659391616:0@lo:503: 00000100:00100000:2.0:1783349753.231438:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349753.231463:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea375e269c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349753.231500:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659391616 00000100:00100000:1.0:1783349753.231504:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659391616 00000100:00100000:1.0:1783349753.231521:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783349753.231527:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659391616:12345-0@lo:503: 00000100:00100000:1.0:1783349753.231597:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659391616:12345-0@lo:503: Request processed in 70us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349753.231604:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783349753.231762:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659391616:0@lo:503: 00000100:00100000:3.0:1783349753.232096:0:8056:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8056:1869977659391744:0@lo:502: 00000100:00100000:3.0:1783349753.232131:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349753.232290:0:8056:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349753.232384:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659391744 00000100:00100000:1.0:1783349753.232388:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659391744 00000100:00100000:1.0:1783349753.232411:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783349753.232424:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:8056:x1869977659391744:12345-0@lo:502: 00000100:00100000:1.0:1783349753.232501:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:8056:x1869977659391744:12345-0@lo:502: Request processed in 77us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349753.232509:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783349753.232573:0:8056:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8056:1869977659391744:0@lo:502: 00000020:01000000:2.0:1783349753.232594:0:8056:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349753.232602:0:8056:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349753.232605:0:8056:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783349753.232611:0:8056:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea3461c1000 00000020:00000080:2.0:1783349753.232614:0:8056:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783349753.232645:0:8056:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8056:1869977659391872:0@lo:502: 00000100:00100000:2.0:1783349753.232675:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349753.232700:0:8056:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea375e269c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349753.232789:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659391872 00000100:00100000:1.0:1783349753.232793:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659391872 00000100:00100000:1.0:1783349753.232811:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783349753.232817:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:8056:x1869977659391872:12345-0@lo:502: 00000100:00100000:1.0:1783349753.232882:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:8056:x1869977659391872:12345-0@lo:502: Request processed in 64us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349753.232888:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783349753.232948:0:8056:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8056:1869977659391872:0@lo:502: 00000020:01000000:2.0:1783349753.232965:0:8056:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349753.232969:0:8056:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349753.232975:0:8056:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783349753.232978:0:8056:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1783349753.233106:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783349753.233124:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783349753.233132:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349753.233258:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349753.478970:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349754.500757:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349754.756420:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659392128:0@lo:400: 00000100:00100000:3.0:1783349754.756491:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349754.756545:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783349754.756551:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659392000:0@lo:400: 00000100:00100000:3.0:1783349754.756579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349754.756599:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659392512:0@lo:400: 00000100:00100000:3.0:1783349754.756621:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349754.756645:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659392256:0@lo:400: 00000100:00100000:3.0:1783349754.756668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349754.756697:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349754.756702:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659392384:0@lo:400: 00000100:00100000:3.0:1783349754.756725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349754.756753:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659392512 00000100:00100000:3.0:1783349754.756759:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659392512 00000100:00100000:3.0:1783349754.756799:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659392256 00000100:00100000:3.0:1783349754.756803:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659392256 00000100:00100000:3.0:1783349754.756819:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783349754.756827:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659392512:12345-0@lo:400: 00000100:00100000:3.0:1783349754.756889:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659392512:12345-0@lo:400: Request processed in 61us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349754.756903:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783349754.757036:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783349754.757057:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659392256:12345-0@lo:400: 00000100:00100000:3.0:1783349754.757094:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659392256:12345-0@lo:400: Request processed in 51us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349754.757101:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783349754.757159:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659392256:0@lo:400: 00000100:00100000:3.0:1783349754.757186:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659392512:0@lo:400: 00000100:00100000:0.0:1783349754.757429:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659392128 00000100:00100000:0.0:1783349754.757434:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659392128 00000100:00100000:0.0:1783349754.757471:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659392384 00000100:00100000:0.0:1783349754.757474:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659392384 00000100:00100000:0.0:1783349754.757498:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349754.757503:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659392128:12345-0@lo:400: 00000100:00100000:0.0:1783349754.757542:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659392128:12345-0@lo:400: Request processed in 38us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349754.757547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349754.757561:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783349754.757566:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659392384:12345-0@lo:400: 00000100:00100000:0.0:1783349754.757598:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659392384:12345-0@lo:400: Request processed in 32us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349754.757603:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783349754.757633:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea36cce8e00 x1869977659392384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349754.757643:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659392384:0@lo:400: 00010000:00080000:0.0:1783349754.757664:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea36cce9500 x1869977659392128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349754.757681:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659392128:0@lo:400: 00000100:00100000:0.0:1783349754.760278:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659392000 00000100:00100000:0.0:1783349754.760291:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659392000 00000100:00100000:0.0:1783349754.760343:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783349754.760352:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3649:x1869977659392000:12345-0@lo:400: 00000100:00100000:0.0:1783349754.760443:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3649:x1869977659392000:12345-0@lo:400: Request processed in 92us (3862us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349754.760450:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783349754.760506:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659392000:0@lo:400: 00000100:00100000:0.0:1783349754.761669:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659392640:0@lo:41: 00000100:00100000:0.0:1783349754.761737:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349754.761796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659392640 00000100:00100000:3.0:1783349754.761801:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659392640 00000100:00100000:3.0:1783349754.761844:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783349754.761852:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659392640:12345-0@lo:41: 00000004:00000024:3.0:1783349754.761881:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1783349754.762714:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659392640:12345-0@lo:41: Request processed in 859us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349754.762724:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783349754.768792:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659392640:0@lo:41: 00010000:00010000:0.0:1783349755.528575:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349756.548298:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349757.580298:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349758.341280:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349758.341306:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659392768:0@lo:41: 00000100:00100000:0.0:1783349758.341373:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349758.342097:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659392768 00000100:00100000:1.0:1783349758.342106:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659392768 00000100:00100000:1.0:1783349758.342230:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349758.342239:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659392768:12345-0@lo:41: 00000004:00000024:1.0:1783349758.342274:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1783349758.342411:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659392768:12345-0@lo:41: Request processed in 173us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349758.342426:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783349758.342460:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659392768:0@lo:41: 00010000:00010000:3.0:1783349758.596352:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783349758.767632:0:8425:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783349758.767636:0:8425:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783349758.767637:0:8425:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783349758.767848:0:8425:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ea36d918000 00000020:01000004:3.0:1783349758.768207:0:8425:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783349758.768221:0:8425:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783349758.768235:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ea370dfb380) 00000020:00000080:3.0:1783349758.768258:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783349758.809822:0:8425:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783349758.809882:0:8425:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1783349758.834775:0:8425:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783349758.835379:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783349758.835389:0:8425:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783349758.835398:0:8425:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd05e6ae1590e1dc1 00000020:01000004:3.0:1783349758.835403:0:8425:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783349758.835422:0:8425:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783349758.835425:0:8425:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783349758.835429:0:8425:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783349758.835433:0:8425:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783349758.835443:0:8425:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ea370df8000) 00000020:00000080:3.0:1783349758.835452:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1783349758.839125:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783349758.839329:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783349758.839335:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783349758.841241:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783349758.841253:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783349758.842691:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783349758.842701:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783349758.847396:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349758.847573:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783349758.847580:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783349758.849989:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783349758.850001:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783349758.879423:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783349758.879711:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783349758.879718:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783349758.881838:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783349758.881852:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783349758.885750:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783349758.885837:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783349758.889041:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349758.891054:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783349758.891061:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783349758.892074:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783349758.892082:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783349758.932769:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349758.932939:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783349758.932945:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783349758.938336:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783349758.938353:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783349758.938841:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783349758.938869:0:8425:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783349758.938875:0:8425:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783349758.956391:0:8425:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783349758.956429:0:8425:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.150@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1783349758.956434:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783349758.956436:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349758.956437:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349758.956439:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349758.956440:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349758.956442:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349758.956444:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349758.956446:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783349758.956448:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783349758.956450:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349758.956451:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783349758.956455:0:8425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1783349758.956457:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783349758.956458:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349758.956464:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349758.956465:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349758.956466:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349758.956467:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349758.956468:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349758.956469:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783349758.956470:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783349758.956471:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349758.956472:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783349758.956507:0:8425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783349758.956526:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659392896:0@lo:253: 00000100:00100000:2.0:1783349758.956594:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349758.956707:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3455c56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349758.956755:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659392896 00000100:00100000:0.0:1783349758.956763:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659392896 00000100:00100000:0.0:1783349758.956871:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783349758.956882:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:8425:x1869977659392896:12345-0@lo:253: 20000000:01000000:0.0:1783349758.956913:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783349758.956917:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1783349758.956922:0:6510:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1783349758.956925:0:6510:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1783349758.957176:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349758.957356:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1783349758.957370:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1783349758.957401:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1783349758.957410:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1783349758.957423:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1783349758.957438:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1783349758.957531:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1783349758.957547:0:6510:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.150@tcp 20000000:01000000:0.0:1783349758.957549:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:0.0:1783349758.957563:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1783349758.957569:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783349758.957583:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1783349758.957589:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:0.0:1783349758.957600:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1783349758.957607:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1783349758.957619:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1783349758.957634:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1783349758.957715:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1783349758.957726:0:6510:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.150@tcp 20000000:01000000:0.0:1783349758.957727:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:0.0:1783349758.957742:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1783349758.957748:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783349758.957761:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1783349758.957766:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:0.0:1783349758.957777:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1783349758.957783:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1783349758.957794:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1783349758.957808:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1783349758.958200:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1783349758.958214:0:6510:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.150@tcp 20000000:01000000:0.0:1783349758.958215:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:0.0:1783349758.958247:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1783349758.958255:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783349758.958269:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1783349758.958275:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:0.0:1783349758.958289:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1783349758.958303:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1783349758.958320:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1783349758.958337:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1783349758.958350:0:6510:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783349758.958353:0:6510:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783349758.958357:0:6510:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783349758.958397:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783349758.958400:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783349758.959110:0:8444:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1783349758.959447:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1783349758.959472:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1783349758.959488:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1783349758.959499:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783349758.959501:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783349758.959858:0:8445:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1783349758.959878:0:8445:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1783349758.959893:0:8445:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1783349758.960038:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1783349758.960059:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1783349758.960074:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1783349758.960083:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783349758.960084:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783349758.960473:0:8446:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1783349758.960499:0:8446:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1783349758.960515:0:8446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1783349758.960674:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1783349758.960694:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1783349758.960708:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1783349758.960716:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783349758.960718:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783349758.962925:0:8447:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1783349758.962976:0:8447:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1783349758.962997:0:8447:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1783349758.963504:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1783349758.963531:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1783349758.963550:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1783349758.963569:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783349758.963590:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.963609:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e1c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1c94 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.963617:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e1d12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d0b expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.963639:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e1d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d43 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.965578:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e1d66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d5f expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.965587:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e1d90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d89 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.965596:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.965660:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e1d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1d89 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.965677:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e1d90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d89 expref: 18 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.965693:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659393024:0@lo:104: 00000100:00100000:3.0:1783349758.965828:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349758.966085:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659393024 00000100:00100000:2.0:1783349758.966093:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659393024 00000100:00100000:2.0:1783349758.966203:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783349758.966213:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659393024:12345-0@lo:104: 00010000:00010000:2.0:1783349758.966226:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e1d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.966280:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e1d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1d5f expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.966281:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783349758.966287:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659393024:12345-0@lo:104: Request processed in 76us (459us total) trans 0 rc 0/0 00010000:00010000:3.0:1783349758.966290:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e1d66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d5f expref: 18 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.966294:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349758.966300:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659393152:0@lo:104: 00000100:00100000:3.0:1783349758.966345:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349758.966370:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e1d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1d43 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.966405:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349758.966412:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e1d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.966419:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349758.966423:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e1d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.966432:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e1d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349758.966440:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e1d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349758.966445:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349758.966486:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e1d89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.966493:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349758.966523:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e1d89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.966530:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e1d89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.966548:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349758.966550:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349758.966552:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349758.966677:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659393408:0@lo:103: 00000100:00100000:0.0:1783349758.966712:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349758.966783:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659393408 00000100:00100000:2.0:1783349758.966793:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659393408 00010000:00010000:2.0:1783349758.966812:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e1d90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d89 expref: 19 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.966877:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783349758.966886:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3647:x1869977659393408:12345-0@lo:103: 00010000:00010000:2.0:1783349758.966898:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349758.966903:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e1d90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d89 expref: 19 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.967003:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e1d4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d43 expref: 19 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.967014:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659393280:0@lo:104: 00000100:00100000:3.0:1783349758.967032:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659393152 00000100:00100000:3.0:1783349758.967036:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659393152 00000100:00100000:3.0:1783349758.967351:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349758.967360:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659393152:12345-0@lo:104: 00010000:00010000:3.0:1783349758.967371:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e1d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.967413:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349758.967418:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659393152:12345-0@lo:104: Request processed in 61us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349758.967424:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1783349758.969012:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e1d90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d89 expref: 19 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.969053:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349758.969273:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3647:x1869977659393408:12345-0@lo:103: Request processed in 2387us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349758.969282:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783349758.970254:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659393408:0@lo:103: 00010000:00010000:2.0:1783349758.970313:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349758.970320:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e1d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.970330:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349758.970334:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e1d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.970344:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e1d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349758.970351:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e1d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349758.970376:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349758.970424:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e1d5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.970431:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349758.970460:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e1d5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.970468:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e1d5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.970479:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349758.970481:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349758.970483:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349758.970489:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349758.970502:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659393536:0@lo:103: 00000100:00100000:2.0:1783349758.970549:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349758.970557:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349758.970593:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659393536 00010000:00010000:3.0:1783349758.970594:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e1d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1d0b expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.970598:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659393536 00010000:00010000:3.0:1783349758.970605:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e1d12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d0b expref: 19 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.970614:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659393664:0@lo:104: 00010000:00010000:2.0:1783349758.970619:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e1d66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d5f expref: 19 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.970634:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349758.970658:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1783349758.970663:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e1c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1c94 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.970665:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3649:x1869977659393536:12345-0@lo:103: 00010000:00010000:3.0:1783349758.970671:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e1c9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c94 expref: 19 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.970676:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349758.970680:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e1d66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d5f expref: 19 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.970686:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659393792:0@lo:104: 00010000:00010000:2.0:1783349758.970689:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e1d66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d5f expref: 19 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.970707:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349758.970718:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349758.970730:0:6510:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21540 going to sleep for 11 seconds 00000100:00100000:2.0:1783349758.970733:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3649:x1869977659393536:12345-0@lo:103: Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349758.970739:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1783349758.970742:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e1d90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1d89 expref: 19 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.970834:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659393024:0@lo:104: 00010000:00010000:3.0:1783349758.970849:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f1800/0xd05e6ae1590e1d66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1d5f expref: 17 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.970858:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659393152:0@lo:104: 00000100:00100000:3.0:1783349758.970992:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659393280 00000100:00100000:3.0:1783349758.970996:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659393280 00000100:00100000:3.0:1783349758.971012:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659393664 00000100:00100000:3.0:1783349758.971014:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659393664 00000100:00100000:3.0:1783349758.971022:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659393792 00000100:00100000:3.0:1783349758.971023:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659393792 00000100:00100000:3.0:1783349758.971033:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349758.971038:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:6510:x1869977659393280:12345-0@lo:104: 00010000:00010000:3.0:1783349758.971047:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea340030a00/0xd05e6ae1590e1d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349758.971193:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659393536:0@lo:103: 00010000:00010000:3.0:1783349758.971365:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349758.971372:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:6510:x1869977659393280:12345-0@lo:104: Request processed in 334us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349758.971430:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349758.971443:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783349758.971520:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6510:x1869977659393664:12345-0@lo:104: 00010000:00010000:3.0:1783349758.971528:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.971561:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783349758.971566:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349758.971572:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6510:x1869977659393664:12345-0@lo:104: Request processed in 55us (936us total) trans 0 rc 0/0 00010000:00010000:1.0:1783349758.971572:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340030a00/0xd05e6ae1590e1d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.971578:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1783349758.971579:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030a00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349758.971583:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340030a00/0xd05e6ae1590e1d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.971590:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340030a00/0xd05e6ae1590e1d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.971592:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:00010000:1.0:1783349758.971597:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340030a00/0xd05e6ae1590e1d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.971598:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659393792:12345-0@lo:104: 10000000:01000000:1.0:1783349758.971603:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349758.971604:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.971629:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea340030a00/0xd05e6ae1590e1d43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.971636:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349758.971661:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1783349758.971662:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340030a00/0xd05e6ae1590e1d43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.971668:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659393920:0@lo:103: 00000100:00100000:3.0:1783349758.971669:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659393792:12345-0@lo:104: Request processed in 69us (948us total) trans 0 rc 0/0 00010000:00010000:1.0:1783349758.971670:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340030a00/0xd05e6ae1590e1d43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.971679:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1783349758.971687:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349758.971690:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.971694:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349758.971696:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525000 already unused, calling callback (ffffffffc1361c20) 00010000:00010000:3.0:1783349758.971698:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349758.971699:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.971704:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:3.0:1783349758.971707:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.971714:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.971716:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349758.971721:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349758.971722:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349758.971729:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783349758.971730:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349758.971746:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1d0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.971752:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349758.971767:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1d0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.971776:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783349758.971779:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1d0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d12 expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.971793:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349758.971795:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349758.971798:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349758.971832:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1c94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.971838:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349758.971844:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1c94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.971850:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1c94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1c9b expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.971923:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659393920 00000100:00100000:2.0:1783349758.971928:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659393920 00010000:00010000:2.0:1783349758.971948:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e1d4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d43 expref: 17 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.971970:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783349758.971977:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:3649:x1869977659393920:12345-0@lo:103: 00010000:00010000:3.0:1783349758.971983:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349758.971987:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349758.971987:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349758.971989:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349758.971994:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e1d4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d43 expref: 17 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.972004:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659394048:0@lo:103: 00010000:00010000:2.0:1783349758.972007:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e1d4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d43 expref: 17 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349758.972021:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659393280:0@lo:104: 00010000:00010000:2.0:1783349758.972025:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e1d4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1d43 expref: 17 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.972035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349758.972046:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349758.972054:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659393664:0@lo:104: 00000100:00100000:3.0:1783349758.972060:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349758.972064:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659393792:0@lo:104: 00000100:00100000:2.0:1783349758.972090:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3649:x1869977659393920:12345-0@lo:103: Request processed in 111us (316us total) trans 0 rc 0/0 00010000:00010000:0.0:1783349758.972095:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.972100:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783349758.972119:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659394048 00000100:00100000:3.0:1783349758.972128:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659394176:0@lo:103: 00000100:00100000:2.0:1783349758.972129:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659394048 00000100:00100000:3.0:1783349758.972177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349758.972202:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349758.972210:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659394176 00000100:00100000:3.0:1783349758.972214:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659394176 00010000:00010000:3.0:1783349758.972227:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e1c9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c94 expref: 17 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.972241:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783349758.972246:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea35094f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:3646:x1869977659394176:12345-0@lo:103: 00010000:00010000:3.0:1783349758.972253:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349758.972264:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e1c9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c94 expref: 17 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.972272:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e1c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1c94 expref: 17 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.972282:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e1c9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1c94 expref: 17 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.972291:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349758.972328:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea35094f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3646:x1869977659394176:12345-0@lo:103: Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349758.972334:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783349758.972600:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659394176:0@lo:103: 00010000:00010000:2.0:1783349758.973525:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e1d12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d0b expref: 15 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.973562:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783349758.973571:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3646:x1869977659394048:12345-0@lo:103: 00010000:00010000:2.0:1783349758.973583:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349758.973588:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e1d12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d0b expref: 15 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973601:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e1d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d0b expref: 15 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973617:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e1d12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1d0b expref: 15 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973631:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973649:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973918:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973928:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973935:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973941:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973960:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783349758.973965:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973973:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.973996:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.974005:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349758.974066:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:3646:x1869977659394048:12345-0@lo:103: Request processed in 497us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349758.974073:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783349758.974157:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659393920:0@lo:103: 00010000:00010000:0.0:1783349758.974226:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349758.974235:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349758.974241:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1dcf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783349758.974256:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783349758.974425:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659394048:0@lo:103: 00000100:00100000:0.0:1783349758.979250:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:8425:x1869977659392896:12345-0@lo:253: Request processed in 22362us (22648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349758.979616:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783349758.979751:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659392896:0@lo:253: 10000000:01000000:2.0:1783349758.979766:0:8425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783349758.979769:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783349758.979771:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349758.979772:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349758.979773:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1783349758.979774:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349758.979776:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349758.979777:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349758.979778:0:8425:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783349758.979780:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349758.979781:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783349758.979809:0:8425:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea36d918000 from lustre-OST0000 10000000:01000000:2.0:1783349758.979911:0:8425:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783349758.979914:0:8425:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783349758.979933:0:8425:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ea349f8b380 local copy 10000000:01000000:2.0:1783349758.979937:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783349758.980202:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.980214:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.980223:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.980241:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659394304:0@lo:101: 00000100:00100000:2.0:1783349758.980399:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349758.980481:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349758.980526:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659394304 00000100:00100000:3.0:1783349758.980533:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659394304 00000100:00100000:3.0:1783349758.980578:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783349758.980586:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:8425:x1869977659394304:12345-0@lo:101: 00010000:00010000:3.0:1783349758.980599:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349758.980613:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1ddd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1dd6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.980636:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1ddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1dd6 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.980655:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1ddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1dd6 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.980663:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341524600, rc 0) 00000100:00100000:3.0:1783349758.980745:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659394304:12345-0@lo:101: Request processed in 159us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349758.980759:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783349758.980932:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659394304:0@lo:101: 00010000:00010000:2.0:1783349758.980946:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.980955:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.981051:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659394432:0@lo:501: 00000100:00100000:2.0:1783349758.981079:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349758.981103:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349758.981165:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659394432 00000100:00100000:0.0:1783349758.981170:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659394432 00000100:00100000:0.0:1783349758.981200:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783349758.981207:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659394432:12345-0@lo:501: 00000100:00100000:0.0:1783349758.981383:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659394432:12345-0@lo:501: Request processed in 175us (301us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349758.981390:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783349758.981444:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659394432:0@lo:501: 10000000:01000000:2.0:1783349758.981462:0:8425:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783349758.981478:0:8425:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783349758.981483:0:8425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.981498:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.981504:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.981568:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783349758.981594:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea36d918000 10000000:01000000:2.0:1783349758.981599:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783349758.981605:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783349758.981607:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783349758.981611:0:8425:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783349758.981614:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783349758.981632:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.981655:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.981663:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.981675:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659394560:0@lo:101: 00000100:00100000:2.0:1783349758.981701:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349758.981730:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4600 going to sleep for 11 seconds 00000100:00100000:1.0:1783349758.982010:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659394560 00000100:00100000:1.0:1783349758.982017:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659394560 00000100:00100000:1.0:1783349758.982060:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783349758.982069:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659394560:12345-0@lo:101: 00010000:00010000:1.0:1783349758.982079:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349758.982092:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e1deb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1de4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.982112:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e1deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1de4 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.982132:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e1deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1de4 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349758.982168:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea38215fc00, rc 0) 00010000:00010000:3.0:1783349758.982196:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349758.982205:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.982214:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd000 already unused, calling callback (ffffffffc1361c20) 00000100:00100000:1.0:1783349758.982215:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659394560:12345-0@lo:101: Request processed in 147us (512us total) trans 0 rc 0/0 10000000:00010000:3.0:1783349758.982220:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349758.982226:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:3.0:1783349758.982236:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349758.982243:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349758.982249:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783349758.982371:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659394560:0@lo:101: 00010000:00010000:2.0:1783349758.982383:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349758.982401:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349758.982477:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659394688:0@lo:501: 00000100:00100000:2.0:1783349758.982504:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349758.982535:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4600 going to sleep for 11 seconds 00010000:00010000:3.0:1783349758.982576:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.982583:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783349758.982731:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349758.982743:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659394688 00000100:00100000:1.0:1783349758.982749:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659394688 00010000:00010000:3.0:1783349758.982752:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.982760:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e1dd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd05e6ae1590e1ddd expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349758.982773:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349758.982776:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349758.982779:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349758.982782:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783349758.982791:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659394688:12345-0@lo:501: 00000100:00100000:2.0:1783349758.982916:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659394816:0@lo:103: 00000100:00100000:1.0:1783349758.982918:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659394688:12345-0@lo:501: Request processed in 126us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349758.982929:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783349758.982953:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349758.982988:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659394816 00000100:00100000:1.0:1783349758.982992:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659394816 00000100:00100000:1.0:1783349758.983023:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349758.983029:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659394688:0@lo:501: 00000100:00100000:1.0:1783349758.983033:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3649:x1869977659394816:12345-0@lo:103: 00010000:00010000:1.0:1783349758.983046:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349758.983061:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1ddd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e1dd6 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349758.983070:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659394944:0@lo:503: 00010000:00010000:1.0:1783349758.983072:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349758.983110:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:3649:x1869977659394816:12345-0@lo:103: Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349758.983121:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349758.983125:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349758.983192:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349758.983224:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659394944 00000100:00100000:3.0:1783349758.983228:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659394944 00000100:00100000:3.0:1783349758.983268:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783349758.983275:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659394944:12345-0@lo:503: 00000100:00100000:3.0:1783349758.983354:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659394944:12345-0@lo:503: Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349758.983361:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783349758.983405:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659394944:0@lo:503: 00000040:00080000:3.0:1783349758.983633:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783349758.983711:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395072:0@lo:502: 00000100:00100000:3.0:1783349758.983743:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349758.983766:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f210c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349758.983941:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659395072 00000100:00100000:0.0:1783349758.983947:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659395072 00000100:00100000:0.0:1783349758.983996:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783349758.984004:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659395072:12345-0@lo:502: 00000100:00100000:0.0:1783349758.984092:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659395072:12345-0@lo:502: Request processed in 89us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349758.984099:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783349758.984259:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659394816:0@lo:103: 00000100:00100000:2.0:1783349758.984348:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395072:0@lo:502: 00000040:00080000:2.0:1783349758.984569:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783349758.984597:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1783349758.984611:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1783349758.984626:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1783349758.989197:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1783349758.989333:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1783349758.989416:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395200:0@lo:502: 00000100:00100000:2.0:1783349758.989496:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349758.989543:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349758.991003:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659395200 00000100:00100000:3.0:1783349758.991016:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659395200 00000100:00100000:3.0:1783349758.992012:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783349758.992029:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659395200:12345-0@lo:502: 00000100:00100000:3.0:1783349758.992208:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659395200:12345-0@lo:502: Request processed in 184us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349758.992216:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783349758.994542:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395200:0@lo:502: 00000040:00080000:2.0:1783349758.994661:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783349758.994676:0:8425:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1783349758.995563:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783349758.995577:0:8448:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1783349758.995584:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349758.995586:0:8448:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783349758.995592:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783349758.995612:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ea241dcb380) 00000020:00000080:1.0:1783349758.995632:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783349758.995638:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783349758.995721:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea36d918000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783349758.995728:0:8448:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783349758.995734:0:8448:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd05e6ae1590e1df9 00010000:00010000:0.0:1783349759.006909:0:8448:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1783349759.012124:0:8448:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1783349759.022708:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1783349759.023431:0:8448:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1783349759.031553:0:8448:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1783349759.031747:0:8448:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1783349759.039536:0:8448:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1783349759.041513:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783349759.041525:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349759.041530:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349759.041532:0:8448:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783349759.041535:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349759.041541:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349759.041542:0:8448:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783349759.041546:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783349759.041548:0:8448:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783349759.041568:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349759.041572:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349759.041574:0:8448:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783349759.041577:0:8448:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783349759.041783:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1783349759.041823:0:8425:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783349759.041845:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.041878:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349759.041886:0:8425:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d918000 from 1 10000000:01000000:3.0:1783349759.041888:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349759.041927:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.041934:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.041944:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349759.041971:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395328:0@lo:101: 00000100:00100000:3.0:1783349759.042044:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.042090:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f210c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349759.042202:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659395328 00000100:00100000:0.0:1783349759.042210:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659395328 00000100:00100000:0.0:1783349759.042268:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783349759.042279:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:8425:x1869977659395328:12345-0@lo:101: 00010000:00010000:0.0:1783349759.042292:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349759.042304:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e1e07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1e00 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349759.042327:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e1e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e00 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349759.042338:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e1e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e00 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349759.042347:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e200, rc 0) 00000100:00100000:0.0:1783349759.043180:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659395328:12345-0@lo:101: Request processed in 899us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349759.043190:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783349759.049276:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395328:0@lo:101: 00010000:00010000:3.0:1783349759.049309:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.049324:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349759.049444:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395456:0@lo:501: 00000100:00100000:3.0:1783349759.049508:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.049563:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349759.049615:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659395456 00000100:00100000:3.0:1783349759.049625:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659395456 00000100:00100000:3.0:1783349759.049695:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783349759.049706:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659395456:12345-0@lo:501: 00000100:00100000:3.0:1783349759.051816:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659395456:12345-0@lo:501: Request processed in 2106us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349759.051828:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783349759.051877:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395456:0@lo:501: 00000100:00100000:2.0:1783349759.051927:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395584:0@lo:503: 00000100:00100000:2.0:1783349759.051976:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349759.052020:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4000 going to sleep for 11 seconds 00000100:00100000:3.0:1783349759.053853:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659395584 00000100:00100000:3.0:1783349759.053865:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659395584 00000100:00100000:3.0:1783349759.053930:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783349759.053940:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659395584:12345-0@lo:503: 00000100:00100000:3.0:1783349759.054089:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659395584:12345-0@lo:503: Request processed in 149us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349759.054096:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783349759.054125:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395584:0@lo:503: 00000040:00080000:3.0:1783349759.054551:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783349759.054619:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395712:0@lo:502: 00000100:00100000:3.0:1783349759.054671:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.054731:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea34558ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783349759.062905:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659395712 00000100:00100000:2.0:1783349759.062919:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659395712 00000100:00100000:2.0:1783349759.062981:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783349759.062991:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659395712:12345-0@lo:502: 00000100:00100000:2.0:1783349759.063202:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659395712:12345-0@lo:502: Request processed in 211us (8528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349759.063211:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783349759.063256:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395712:0@lo:502: 00000040:00080000:0.0:1783349759.063484:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1783349759.063514:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783349759.063557:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395840:0@lo:502: 00000100:00100000:0.0:1783349759.063602:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349759.063627:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc16d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783349759.064230:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659395840 00000100:00100000:2.0:1783349759.064238:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659395840 00000100:00100000:2.0:1783349759.064281:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783349759.064289:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659395840:12345-0@lo:502: 00000100:00100000:2.0:1783349759.064388:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659395840:12345-0@lo:502: Request processed in 100us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349759.064395:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783349759.064440:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395840:0@lo:502: 00000040:00080000:0.0:1783349759.064491:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783349759.064501:0:8425:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783349759.064978:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349759.064987:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349759.064989:0:8452:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783349759.064994:0:8452:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea36d918000 00000020:00000080:0.0:1783349759.064997:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783349759.065009:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349759.065011:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349759.065013:0:8452:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783349759.065015:0:8452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783349759.065132:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783349759.065181:0:8425:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783349759.065203:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.065214:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349759.065264:0:8425:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783349759.065267:0:8425:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea36d918000 10000000:01000000:3.0:1783349759.065270:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea36d918000 10000000:01000000:3.0:1783349759.065279:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783349759.065284:0:8425:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea36d918000 from 1 10000000:01000000:3.0:1783349759.065286:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783349759.065314:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.065322:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.065330:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349759.065347:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395968:0@lo:101: 00000100:00100000:3.0:1783349759.065388:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.065412:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349759.065477:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659395968 00000100:00100000:0.0:1783349759.065482:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659395968 00000100:00100000:0.0:1783349759.065511:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783349759.065519:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8425:x1869977659395968:12345-0@lo:101: 00010000:00010000:0.0:1783349759.065530:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349759.065542:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e000/0xd05e6ae1590e1e15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1e0e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349759.065571:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e000/0xd05e6ae1590e1e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e0e expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349759.065582:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8e000/0xd05e6ae1590e1e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e0e expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349759.065590:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e000, rc 0) 00000100:00100000:0.0:1783349759.065629:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659395968:12345-0@lo:101: Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349759.065636:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783349759.065710:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659395968:0@lo:101: 00010000:00010000:3.0:1783349759.065722:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.065730:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349759.065812:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659396096:0@lo:501: 00000100:00100000:3.0:1783349759.065836:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.065856:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349759.066208:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659396096 00000100:00100000:2.0:1783349759.066214:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659396096 00000100:00100000:2.0:1783349759.066250:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783349759.066258:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659396096:12345-0@lo:501: 00000100:00100000:2.0:1783349759.066356:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659396096:12345-0@lo:501: Request processed in 99us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349759.066363:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783349759.066397:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659396096:0@lo:501: 00000100:00100000:3.0:1783349759.066424:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659396224:0@lo:503: 00000100:00100000:3.0:1783349759.066463:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.066496:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349759.066518:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659396224 00000100:00100000:2.0:1783349759.066523:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659396224 00000100:00100000:2.0:1783349759.066550:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783349759.066557:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659396224:12345-0@lo:503: 00000100:00100000:2.0:1783349759.066635:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659396224:12345-0@lo:503: Request processed in 78us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349759.066661:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783349759.066683:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659396224:0@lo:503: 00000040:00080000:3.0:1783349759.066910:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783349759.066981:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659396352:0@lo:502: 00000100:00100000:3.0:1783349759.067013:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.067031:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349759.068258:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659396352 00000100:00100000:2.0:1783349759.068281:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659396352 00000100:00100000:2.0:1783349759.068342:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783349759.068353:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659396352:12345-0@lo:502: 00000100:00100000:2.0:1783349759.068527:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659396352:12345-0@lo:502: Request processed in 176us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349759.068534:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783349759.068575:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659396352:0@lo:502: 00000040:00080000:3.0:1783349759.068884:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783349759.068914:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783349759.068931:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783349759.068945:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783349759.068961:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783349759.068976:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783349759.068992:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783349759.069006:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783349759.069019:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783349759.069033:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783349759.069048:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783349759.069063:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783349759.069078:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783349759.069094:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783349759.069108:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783349759.069121:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783349759.069188:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783349759.069207:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783349759.069221:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783349759.069234:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783349759.069246:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783349759.069258:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783349759.069271:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783349759.069286:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783349759.069312:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783349759.069328:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783349759.069343:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783349759.069357:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1783349759.069371:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783349759.069383:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1783349759.069393:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1783349759.069404:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1783349759.069426:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1783349759.069439:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1783349759.069451:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1783349759.069469:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1783349759.069482:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1783349759.069517:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659396480:0@lo:502: 00000100:00100000:3.0:1783349759.069583:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.069617:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349759.069722:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659396480 00000100:00100000:2.0:1783349759.069730:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659396480 00000100:00100000:2.0:1783349759.069781:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783349759.069790:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659396480:12345-0@lo:502: 00000100:00100000:2.0:1783349759.069920:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659396480:12345-0@lo:502: Request processed in 131us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349759.069927:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783349759.070059:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659396480:0@lo:502: 00000040:00080000:1.0:1783349759.070125:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1783349759.070165:0:8425:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783349759.071693:0:8453:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783349759.071727:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ea2424499c0) 00000020:00000080:2.0:1783349759.071872:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1783349759.072347:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea36d918000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783349759.072353:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea36d918000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783349759.072356:0:8453:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea36d918000 3 00010000:00080000:2.0:1783349759.072391:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea36d8fb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783349759.077434:0:8453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1783349759.077573:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783349759.077630:0:8453:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783349759.077654:0:8453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd05e6ae1590e1e23 00000100:00080000:3.0:1783349759.077665:0:8453:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783349759.077670:0:8453:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ea36d8fb000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783349759.077709:0:8453:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea241da4e00 x1869977659396608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783349759.077736:0:8453:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783349759.077856:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659396608:0@lo:38: 00000100:00100000:0.0:1783349759.078033:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659396736:0@lo:400: 00000100:00100000:2.0:1783349759.079201:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349759.079281:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659396608 00000100:00100000:2.0:1783349759.079290:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659396608 00000100:00100000:2.0:1783349759.079326:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349759.079345:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659396608:12345-0@lo:38: 00010000:00080000:2.0:1783349759.079372:0:6518:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1783349759.079428:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd05e6ae1590e1e2a 00000100:00100000:3.0:1783349759.079442:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659396864:0@lo:400: 00000004:00100000:2.0:1783349759.079446:0:6518:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783349759.079479:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ea36d8fd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349759.079496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.079527:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349759.079537:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659396992:0@lo:400: 00000100:00100000:2.0:1783349759.079541:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869977659396608:12345-0@lo:38: Request processed in 195us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349759.079555:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349759.079572:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659396864 00000100:00100000:2.0:1783349759.079576:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659396864 00000100:00100000:3.0:1783349759.079582:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349759.079603:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783349759.079611:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659396864:12345-0@lo:400: 00000100:00100000:3.0:1783349759.079618:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659396992 00000100:00100000:3.0:1783349759.079623:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659396992 00000100:00100000:2.0:1783349759.079668:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659396864:12345-0@lo:400: Request processed in 58us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349759.079672:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783349759.079681:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349759.079686:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659396992:12345-0@lo:400: 00010000:00080000:2.0:1783349759.081184:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea241da4e00 x1869977659396608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349759.081199:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783349759.081208:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1783349759.081216:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783349759.081222:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783349759.081225:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d8fb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783349759.081231:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659396608:0@lo:38: 00000100:00100000:3.0:1783349759.081517:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659396992:12345-0@lo:400: Request processed in 1831us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349759.081528:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:01000004:3.0:1783349759.081579:0:8453:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783349759.081617:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ea37f45b380) 00000020:00000080:3.0:1783349759.081650:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1783349759.081824:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea36d918000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783349759.081828:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea36d918000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783349759.081830:0:8453:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea36d918000 3 00010000:00080000:3.0:1783349759.081871:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea242414800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783349759.084277:0:8453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1783349759.084426:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1783349759.084483:0:8453:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783349759.084499:0:8453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd05e6ae1590e1e38 00000100:00080000:3.0:1783349759.084510:0:8453:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783349759.084516:0:8453:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ea242414800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783349759.084553:0:8453:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea241da6d80 x1869977659397120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783349759.084583:0:8453:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783349759.086534:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.090207:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869977659397120:0@lo:38: 00000100:00100000:3.0:1783349759.090283:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.090349:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659396736 00000100:00100000:3.0:1783349759.090364:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659396736 00000100:00100000:3.0:1783349759.090400:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659397120 00000100:00100000:3.0:1783349759.090402:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659397120 00000100:00100000:3.0:1783349759.090412:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349759.090419:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659396736:12345-0@lo:400: 00000100:00100000:3.0:1783349759.090469:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659396736:12345-0@lo:400: Request processed in 50us (3940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349759.090476:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349759.090489:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349759.090493:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659397120:12345-0@lo:38: 00010000:00080000:3.0:1783349759.090513:0:6519:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:3.0:1783349759.090543:0:6519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd05e6ae1590e1e3f 00000004:00100000:3.0:1783349759.090557:0:6519:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783349759.090582:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8ea242410800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349759.090614:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869977659397120:12345-0@lo:38: Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349759.090620:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783349759.090682:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea241da6d80 x1869977659397120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349759.090692:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783349759.090699:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1783349759.090706:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783349759.090711:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783349759.090713:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea242414800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783349759.090718:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869977659397120:0@lo:38: 00010000:00080000:3.0:1783349759.090747:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea370d64380 x1869977659396736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349759.090763:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659396736:0@lo:400: 00010000:00080000:2.0:1783349759.092897:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea370d64700 x1869977659396864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349759.092916:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659396864:0@lo:400: 00000100:00100000:2.0:1783349759.092956:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659396992:0@lo:400: 00000040:00080000:3.0:1783349759.093205:0:8453:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1783349759.093930:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1783349759.093963:0:8425:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349759.093990:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349759.094003:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783349759.094192:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783349759.094195:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349759.094196:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349759.094198:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349759.094199:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349759.094201:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349759.094203:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349759.094205:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783349759.094207:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783349759.094208:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349759.094210:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783349759.094214:0:8425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1783349759.094216:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783349759.094218:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349759.094219:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349759.094221:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349759.094222:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349759.094223:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349759.094224:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349759.094225:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783349759.094226:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783349759.094227:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349759.094229:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783349759.094256:0:8425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783349759.094275:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659397248:0@lo:253: 00000100:00100000:2.0:1783349759.094345:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349759.094398:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3455c56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349759.094699:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659397248 00000100:00100000:3.0:1783349759.094707:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659397248 00000100:00100000:3.0:1783349759.094758:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783349759.094768:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659397248:12345-0@lo:253: 20000000:01000000:3.0:1783349759.094795:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783349759.094809:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783349759.109765:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783349759.109784:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783349759.109825:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783349759.109831:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783349759.109854:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.109877:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3429f1000/0xd05e6ae1590e1d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d35 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.109886:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e1d58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d51 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.109893:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.109929:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e1d58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1d51 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.109940:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e1d58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d51 expref: 16 pid: 6511 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349759.109955:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659397376:0@lo:104: 00000100:00100000:3.0:1783349759.110025:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349759.110372:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:8425:x1869977659397248:12345-0@lo:253: Request processed in 15603us (16023us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349759.110382:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783349759.110408:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8425:1869977659397248:0@lo:253: 10000000:01000000:2.0:1783349759.110422:0:8425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783349759.110426:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783349759.110427:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349759.110428:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349759.110429:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349759.110431:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349759.110432:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349759.110433:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349759.110435:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783349759.110436:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783349759.110438:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349759.110439:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783349759.110453:0:8425:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1783349759.112809:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3429f1000/0xd05e6ae1590e1d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1d35 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.112826:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea3429f1000/0xd05e6ae1590e1d3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d35 expref: 15 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349759.112842:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659397504:0@lo:104: 00000100:00100000:3.0:1783349759.112890:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227540 going to sleep for 11 seconds 00080000:10000000:2.0:1783349759.113710:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783349759.113874:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783349759.114299:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783349759.114464:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783349759.114706:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00000100:00100000:0.0:1783349759.115781:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783349759.115826:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349759.115865:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659397376 00000100:00100000:0.0:1783349759.115872:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659397376 00000100:00100000:1.0:1783349759.115891:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659397504 00000100:00100000:0.0:1783349759.115916:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783349759.115925:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d9bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6533:x1869977659397376:12345-0@lo:104: 00010000:00010000:0.0:1783349759.115952:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea340031e00/0xd05e6ae1590e1d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349759.116017:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783349759.116031:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d9bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6533:x1869977659397376:12345-0@lo:104: Request processed in 107us (6005us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349759.116038:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1783349759.116539:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349759.116547:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340031e00/0xd05e6ae1590e1d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.116555:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031e00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:3.0:1783349759.116558:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031e00/0xd05e6ae1590e1d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.116566:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340031e00/0xd05e6ae1590e1d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349759.116573:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031e00/0xd05e6ae1590e1d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349759.116579:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349759.116620:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea340031e00/0xd05e6ae1590e1d51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.116627:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349759.116656:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340031e00/0xd05e6ae1590e1d51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.116673:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340031e00/0xd05e6ae1590e1d51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.116686:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349759.116688:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349759.116690:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349759.116737:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659397632:0@lo:103: 00000100:00100000:3.0:1783349759.116777:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.116826:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659397632 00000100:00100000:3.0:1783349759.116831:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659397632 00010000:00010000:3.0:1783349759.116853:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e1d58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d51 expref: 16 pid: 6511 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349759.116889:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783349759.116897:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3648:x1869977659397632:12345-0@lo:103: 00010000:00010000:3.0:1783349759.116908:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349759.116914:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e1d58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d51 expref: 16 pid: 6511 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.116923:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e1d58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d51 expref: 16 pid: 6511 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349759.116982:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659397504 00000100:00100000:0.0:1783349759.117057:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783349759.117065:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6533:x1869977659397504:12345-0@lo:104: 00010000:00010000:0.0:1783349759.117073:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea340030200/0xd05e6ae1590e1d35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349759.117111:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783349759.117116:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6533:x1869977659397504:12345-0@lo:104: Request processed in 53us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349759.117122:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1783349759.117295:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349759.117331:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3648:x1869977659397632:12345-0@lo:103: Request processed in 435us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349759.117338:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1783349759.117358:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349759.117362:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340030200/0xd05e6ae1590e1d35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.117375:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:3.0:1783349759.117378:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340030200/0xd05e6ae1590e1d35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.117384:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340030200/0xd05e6ae1590e1d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349759.117389:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340030200/0xd05e6ae1590e1d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349759.117394:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349759.117417:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea340030200/0xd05e6ae1590e1d35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.117424:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349759.117430:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340030200/0xd05e6ae1590e1d35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.117436:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340030200/0xd05e6ae1590e1d35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1d3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.117450:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349759.117452:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349759.117453:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349759.117479:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659397760:0@lo:103: 00000100:00100000:3.0:1783349759.117506:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349759.117542:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659397760 00000100:00100000:0.0:1783349759.117738:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659397632:0@lo:103: 00000100:00100000:3.0:1783349759.117781:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659397760 00010000:00010000:3.0:1783349759.117801:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3429f1000/0xd05e6ae1590e1d3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d35 expref: 16 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349759.117877:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783349759.117885:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3649:x1869977659397760:12345-0@lo:103: 00010000:00010000:3.0:1783349759.117895:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349759.117900:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3429f1000/0xd05e6ae1590e1d3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d35 expref: 16 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.117909:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3429f1000/0xd05e6ae1590e1d3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d35 expref: 16 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.117925:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.117933:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1783349759.117982:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 20000000:01000000:3.0:1783349759.118022:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008190708s 00010000:00010000:3.0:1783349759.118028:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.118036:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.118042:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.118049:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.118055:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349759.118059:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.118075:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.118085:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349759.118095:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349759.118221:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3649:x1869977659397760:12345-0@lo:103: Request processed in 337us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349759.118228:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783349759.119119:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659397760:0@lo:103: 00010000:00010000:1.0:1783349759.120516:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e1d58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1d51 expref: 15 pid: 6511 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349759.120537:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659397376:0@lo:104: 00010000:00010000:1.0:1783349759.120570:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f1000/0xd05e6ae1590e1d3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1d35 expref: 14 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349759.120581:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659397504:0@lo:104: 00010000:00010000:1.0:1783349759.120601:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349759.120611:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349759.120617:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349759.120623:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1e46 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1783349759.123742:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1783349759.134125:0:8425:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783349759.134154:0:8425:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783349759.134195:0:8425:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783349759.134246:0:8425:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783349759.134265:0:8425:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783349759.134283:0:8425:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1783349759.135108:0:8425:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783349759.135385:0:8425:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1783349759.622557:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349759.878310:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659397888:0@lo:41: 00000100:00100000:2.0:1783349759.878383:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349759.878573:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659397888 00000100:00100000:1.0:1783349759.878582:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659397888 00000100:00100000:1.0:1783349759.878641:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783349759.878651:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659397888:12345-0@lo:41: 00000004:00000024:1.0:1783349759.878687:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783349759.878745:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659397888:12345-0@lo:41: Request processed in 96us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349759.878752:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783349759.878781:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659397888:0@lo:41: 00000020:00000004:2.0:1783349759.909784:0:8509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783349759.909985:0:8509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783349760.645191:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783349760.967076:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783349760.967085:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea357ed9800 from 30 10000000:01000000:0.0:1783349760.967091:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783349760.967162:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349760.967175:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349760.967186:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349760.967212:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398016:0@lo:101: 00000100:00100000:0.0:1783349760.967290:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349760.967350:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349760.968058:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659398016 00000100:00100000:2.0:1783349760.968068:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659398016 00000100:00100000:2.0:1783349760.968129:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783349760.968183:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659398016:12345-0@lo:101: 00010000:00010000:2.0:1783349760.968199:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349760.968222:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e1e54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1e4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349760.968249:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e1e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e4d expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349760.968260:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e1e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e4d expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349760.968269:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd600, rc 0) 00000100:00100000:2.0:1783349760.968327:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659398016:12345-0@lo:101: Request processed in 148us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349760.968336:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783349760.968402:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398016:0@lo:101: 00010000:00010000:2.0:1783349760.968418:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349760.968428:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349760.968502:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398144:0@lo:501: 00000100:00100000:2.0:1783349760.968534:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349760.968557:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349760.968850:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659398144 00000100:00100000:3.0:1783349760.968856:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659398144 00000100:00100000:3.0:1783349760.968891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783349760.968899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659398144:12345-0@lo:501: 00000100:00100000:3.0:1783349760.969064:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659398144:12345-0@lo:501: Request processed in 167us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349760.969071:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783349760.969445:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398144:0@lo:501: 00000100:00100000:1.0:1783349760.969495:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398272:0@lo:503: 00000100:00100000:1.0:1783349760.969574:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349760.969724:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659398272 00000100:00100000:2.0:1783349760.969730:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659398272 00000100:00100000:1.0:1783349760.969733:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349760.969775:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783349760.969783:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659398272:12345-0@lo:503: 00000100:00100000:2.0:1783349760.969885:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659398272:12345-0@lo:503: Request processed in 102us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349760.969901:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783349760.970170:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398272:0@lo:503: 00000100:00100000:2.0:1783349760.970787:0:8575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8575:1869977659398400:0@lo:502: 00000100:00100000:2.0:1783349760.970842:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349760.970882:0:8575:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349760.971221:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659398400 00000100:00100000:1.0:1783349760.971227:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659398400 00000100:00100000:1.0:1783349760.971264:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783349760.971272:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8575:x1869977659398400:12345-0@lo:502: 00000100:00100000:1.0:1783349760.971380:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8575:x1869977659398400:12345-0@lo:502: Request processed in 107us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349760.971389:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783349760.971416:0:8575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8575:1869977659398400:0@lo:502: 00000100:00100000:2.0:1783349760.971468:0:8575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8575:1869977659398528:0@lo:502: 00000100:00100000:2.0:1783349760.971504:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349760.971529:0:8575:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd190c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349760.971585:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659398528 00000100:00100000:0.0:1783349760.971591:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659398528 00000100:00100000:0.0:1783349760.971676:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783349760.971685:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8575:x1869977659398528:12345-0@lo:502: 00000100:00100000:0.0:1783349760.971764:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:8575:x1869977659398528:12345-0@lo:502: Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349760.971770:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783349760.972385:0:8575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8575:1869977659398528:0@lo:502: 00000040:00080000:2.0:1783349760.972409:0:8575:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1783349760.972708:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1783349760.972733:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783349760.972745:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.972757:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349760.972768:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783349760.972770:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea357ed9800 from 5 10000000:01000000:1.0:1783349760.972772:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783349760.972803:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.972812:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.972822:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349760.972840:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398656:0@lo:101: 00000100:00100000:1.0:1783349760.972901:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349760.972939:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1240 going to sleep for 11 seconds 00000100:00100000:1.0:1783349760.972956:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659398656 00000100:00100000:1.0:1783349760.972961:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659398656 00000100:00100000:1.0:1783349760.973008:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783349760.973016:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659398656:12345-0@lo:101: 00010000:00010000:1.0:1783349760.973027:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349760.973040:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e1e62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1e5b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973061:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e1e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e5b expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973071:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e1e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e5b expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973080:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea38215ee00, rc 0) 00000100:00100000:1.0:1783349760.973115:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659398656:12345-0@lo:101: Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349760.973121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783349760.973202:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398656:0@lo:101: 00010000:00010000:1.0:1783349760.973213:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973222:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349760.973274:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398784:0@lo:256: 00000100:00100000:1.0:1783349760.973314:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349760.973334:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1240 going to sleep for 11 seconds 00000100:00100000:1.0:1783349760.973347:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659398784 00000100:00100000:1.0:1783349760.973350:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659398784 00000100:00100000:1.0:1783349760.973372:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783349760.973379:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659398784:12345-0@lo:256: 20000000:01000000:1.0:1783349760.973392:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783349760.973408:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783349760.973411:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1783349760.973493:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659398784:12345-0@lo:256: Request processed in 114us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349760.973501:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783349760.973533:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398784:0@lo:256: 10000000:01000000:1.0:1783349760.973572:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783349760.973579:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973587:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349760.973595:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783349760.973596:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1783349760.973598:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783349760.973616:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973623:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973652:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349760.973664:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398912:0@lo:101: 00000100:00100000:1.0:1783349760.973692:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349760.973707:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1240 going to sleep for 11 seconds 00000100:00100000:1.0:1783349760.973720:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659398912 00000100:00100000:1.0:1783349760.973723:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659398912 00000100:00100000:1.0:1783349760.973745:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783349760.973752:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659398912:12345-0@lo:101: 00010000:00010000:1.0:1783349760.973759:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349760.973778:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e1e70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1e69 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973795:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e1e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e69 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973804:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e1e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e69 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973811:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8ce00, rc 0) 00000100:00100000:1.0:1783349760.973840:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659398912:12345-0@lo:101: Request processed in 90us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349760.973846:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783349760.973876:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659398912:0@lo:101: 00010000:00010000:1.0:1783349760.973885:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349760.973903:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349760.973949:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659399040:0@lo:501: 00000100:00100000:1.0:1783349760.973975:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349760.973999:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349760.974113:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659399040 00000100:00100000:2.0:1783349760.974119:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659399040 00000100:00100000:2.0:1783349760.974169:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783349760.974176:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659399040:12345-0@lo:501: 00000100:00100000:2.0:1783349760.974284:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659399040:12345-0@lo:501: Request processed in 108us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349760.974290:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783349760.974665:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659399040:0@lo:501: 00000100:00100000:1.0:1783349760.974793:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659399168:0@lo:503: 00000100:00100000:1.0:1783349760.974838:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349760.974870:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349760.974931:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659399168 00000100:00100000:2.0:1783349760.974937:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659399168 00000100:00100000:2.0:1783349760.974971:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783349760.974978:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659399168:12345-0@lo:503: 00000100:00100000:2.0:1783349760.975210:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659399168:12345-0@lo:503: Request processed in 232us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349760.975217:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783349760.975320:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659399168:0@lo:503: 00000100:00100000:3.0:1783349760.978020:0:8577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8577:1869977659399296:0@lo:502: 00000100:00100000:3.0:1783349760.978109:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349760.978194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659399296 00000100:00100000:1.0:1783349760.978203:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659399296 00000100:00100000:1.0:1783349760.978267:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783349760.978278:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:8577:x1869977659399296:12345-0@lo:502: 00000100:00100000:3.0:1783349760.978280:0:8577:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349760.978415:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:8577:x1869977659399296:12345-0@lo:502: Request processed in 139us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349760.978423:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783349760.978522:0:8577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8577:1869977659399296:0@lo:502: 00000020:01000000:3.0:1783349760.978552:0:8577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783349760.978561:0:8577:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783349760.978569:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349760.978572:0:8577:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783349760.978578:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783349760.978582:0:8577:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:3.0:1783349760.978605:0:8577:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783349760.978608:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783349760.978624:0:8577:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8ea37f458000) 00000020:00000080:3.0:1783349760.978656:0:8577:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1783349760.978663:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783349760.978743:0:8577:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1783349760.978750:0:8577:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783349760.978756:0:8577:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e1e7e 00010000:00080000:3.0:1783349760.978789:0:8577:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea37f442800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783349760.979316:0:8577:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1783349760.991456:0:8577:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783349760.991481:0:8577:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783349760.991698:0:8577:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783349760.991905:0:8577:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783349760.992006:0:8577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783349760.992090:0:8577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1783349760.997424:0:8579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349760.997444:0:8579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783349760.998982:0:8577:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783349760.999006:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783349760.999049:0:8577:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783349760.999072:0:8577:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e1e85 00000100:00080000:1.0:1783349760.999083:0:8577:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783349760.999090:0:8577:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ea37f442800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783349760.999125:0:8577:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea370df5500 x1869977659399424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783349760.999184:0:8577:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783349760.999245:0:8577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349760.999248:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349760.999252:0:8577:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783349760.999255:0:8577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349760.999259:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349760.999261:0:8577:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783349760.999264:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783349760.999266:0:8577:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783349760.999285:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659399424:0@lo:8: 00000100:00100000:1.0:1783349760.999291:0:8577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8577:1869977659399808:0@lo:502: 00000100:00100000:2.0:1783349760.999331:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659399936:0@lo:400: 00000100:00100000:0.0:1783349760.999342:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659399552:0@lo:400: 00000100:00100000:3.0:1783349760.999379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349760.999379:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349760.999387:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349760.999410:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659400064:0@lo:400: 00000100:00100000:1.0:1783349760.999420:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659399808 00000100:00100000:1.0:1783349760.999426:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659399808 00000100:00100000:2.0:1783349760.999435:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783349760.999446:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659399680:0@lo:400: 00000100:00100000:0.0:1783349760.999446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349760.999452:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659399936 00000100:00100000:3.0:1783349760.999458:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659399936 00000100:00100000:1.0:1783349760.999478:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783349760.999490:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:8577:x1869977659399808:12345-0@lo:502: 00000100:00100000:2.0:1783349760.999491:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349760.999508:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659399424 00000100:00100000:3.0:1783349760.999513:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783349760.999515:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659399424 00000100:00100000:2.0:1783349760.999519:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659400320:0@lo:400: 00000100:00100000:3.0:1783349760.999526:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659399936:12345-0@lo:400: 00000100:00100000:0.0:1783349760.999544:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349760.999551:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659399424:12345-0@lo:8: 00000100:00100000:2.0:1783349760.999566:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783349760.999574:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000100:00100000:3.0:1783349760.999581:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659399936:12345-0@lo:400: Request processed in 57us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349760.999592:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783349760.999592:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:8577:x1869977659399808:12345-0@lo:502: Request processed in 103us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349760.999603:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000020:00000080:0.0:1783349760.999607:0:8431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e1e8c 00010000:00080000:2.0:1783349760.999610:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea379138000 x1869977659399936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349760.999622:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659399936:0@lo:400: 00002000:00100000:0.0:1783349760.999649:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ea36da96800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1783349760.999655:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000100:00100000:1.0:1783349760.999656:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659400064 00000001:00000004:0.0:1783349760.999659:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1783349760.999661:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659400064 00000100:00100000:1.0:1783349760.999693:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659399680 00000100:00100000:1.0:1783349760.999696:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659399680 00000100:00100000:1.0:1783349760.999714:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00002000:00100000:0.0:1783349760.999716:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783349760.999722:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659400064:12345-0@lo:400: 00000100:00100000:1.0:1783349760.999764:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659400064:12345-0@lo:400: Request processed in 44us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349760.999770:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783349760.999781:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783349760.999794:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659399680:12345-0@lo:400: 00000100:00100000:1.0:1783349760.999828:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659399680:12345-0@lo:400: Request processed in 34us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349760.999834:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783349760.999857:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659399680:0@lo:400: 00000100:00100000:1.0:1783349760.999871:0:8577:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3446b4480 going to sleep for 11 seconds 00000100:00100000:1.0:1783349760.999880:0:8577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8577:1869977659399808:0@lo:502: 00000020:01000000:1.0:1783349760.999902:0:8577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349760.999907:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349760.999908:0:8577:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783349760.999912:0:8577:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1783349760.999982:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1783349761.000001:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783349761.000011:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349761.000021:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349761.000031:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783349761.000033:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea3461c1000 from 30 10000000:01000000:2.0:1783349761.000037:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783349761.000063:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349761.000070:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349761.000090:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349761.000104:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659400448:0@lo:101: 00000100:00100000:2.0:1783349761.000131:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349761.000163:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349761.000215:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659400448 00000100:00100000:1.0:1783349761.000219:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659400448 00000100:00100000:1.0:1783349761.000251:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783349761.000258:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659400448:12345-0@lo:101: 00010000:00010000:1.0:1783349761.000266:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349761.000277:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8c800/0xd05e6ae1590e1e9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1e93 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349761.000296:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8c800/0xd05e6ae1590e1e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e93 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349761.000305:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8c800/0xd05e6ae1590e1e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e93 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349761.000314:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c800, rc 0) 00000100:00100000:1.0:1783349761.000342:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659400448:12345-0@lo:101: Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.000357:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783349761.000362:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659400448:0@lo:101: 00010000:00010000:2.0:1783349761.000374:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349761.000383:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349761.000429:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659400576:0@lo:501: 00000100:00100000:2.0:1783349761.000451:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349761.000471:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349761.000516:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659400576 00000100:00100000:1.0:1783349761.000520:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659400576 00000100:00100000:1.0:1783349761.000548:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783349761.000555:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659400576:12345-0@lo:501: 00000100:00100000:1.0:1783349761.000665:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659400576:12345-0@lo:501: Request processed in 110us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.000671:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783349761.000721:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659400576:0@lo:501: 00000100:00100000:3.0:1783349761.000731:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659400320 00000100:00100000:3.0:1783349761.000737:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659400320 00000100:00100000:2.0:1783349761.000751:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659400704:0@lo:503: 00000100:00100000:3.0:1783349761.000769:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1783349761.000769:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783349761.000784:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659400320:12345-0@lo:400: 00000100:00100000:2.0:1783349761.000791:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349761.000809:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349761.000810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659400704 00000100:00100000:1.0:1783349761.000814:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659400704 00000100:00100000:3.0:1783349761.000840:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659400320:12345-0@lo:400: Request processed in 62us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349761.000849:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783349761.000855:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783349761.000865:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659400704:12345-0@lo:503: 00010000:00080000:2.0:1783349761.000907:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea379139c00 x1869977659400320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349761.000918:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659400320:0@lo:400: 00000100:00100000:1.0:1783349761.000940:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659400704:12345-0@lo:503: Request processed in 78us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.000947:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783349761.001083:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659400704:0@lo:503: 00000100:00100000:3.0:1783349761.001436:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349761.001475:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659400192:0@lo:400: 00000100:00100000:3.0:1783349761.001512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349761.001663:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659399552 00000100:00100000:1.0:1783349761.001668:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659399552 00000100:00100000:2.0:1783349761.001678:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659400192 00000100:00100000:2.0:1783349761.001683:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659400192 00000100:00100000:1.0:1783349761.001706:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349761.001714:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659399552:12345-0@lo:400: 00000100:00100000:2.0:1783349761.001716:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783349761.001723:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1783349761.001770:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659399552:12345-0@lo:400: Request processed in 56us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.001776:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349761.001789:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349761.001795:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659400192:12345-0@lo:400: 00000100:00100000:1.0:1783349761.001821:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659400192:12345-0@lo:400: Request processed in 26us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.001832:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783349761.001846:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea379138a80 x1869977659399552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349761.001857:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659399552:0@lo:400: 00010000:00080000:2.0:1783349761.001868:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37913b100 x1869977659400192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349761.001875:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659400192:0@lo:400: 00000100:00080000:1.0:1783349761.002323:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:0.0:1783349761.002874:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1783349761.002913:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ea36da90800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349761.002979:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869977659399424:12345-0@lo:8: Request processed in 3425us (3606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349761.002990:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783349761.004198:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea370df5500 x1869977659399424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783349770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349761.004211:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783349761.004219:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1783349761.004228:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783349761.004234:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783349761.004237:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea37f442800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783349761.004274:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783349761.004282:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659399424:0@lo:8: 00000004:00080000:1.0:1783349761.004330:0:8579:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1783349761.004337:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659400064:0@lo:400: 00000004:00080000:1.0:1783349761.004414:0:8579:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 201799276578ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783349761.004421:0:8579:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1783349761.004473:0:8580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8580:1869977659400832:0@lo:700: 00000100:00100000:2.0:1783349761.004525:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349761.005377:0:8580:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349761.005738:0:8581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8581:1869977659400960:0@lo:502: 00000100:00100000:2.0:1783349761.005793:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349761.005821:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659400960 00000100:00100000:2.0:1783349761.005827:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659400960 00000100:00100000:2.0:1783349761.005870:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783349761.005879:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:8581:x1869977659400960:12345-0@lo:502: 00000100:00100000:2.0:1783349761.005993:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:8581:x1869977659400960:12345-0@lo:502: Request processed in 115us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349761.006001:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783349761.006051:0:8581:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349761.006069:0:8581:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8581:1869977659400960:0@lo:502: 00000100:00100000:2.0:1783349761.006114:0:8581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8581:1869977659401088:0@lo:502: 00000100:00100000:2.0:1783349761.006164:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783349761.006172:0:7448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1783349761.006178:0:8581:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349761.006198:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659401088 00000100:00100000:1.0:1783349761.006202:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659401088 00000100:00100000:1.0:1783349761.006231:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783349761.006239:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:8581:x1869977659401088:12345-0@lo:502: 00000100:00100000:1.0:1783349761.006306:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:8581:x1869977659401088:12345-0@lo:502: Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.006312:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783349761.006580:0:8581:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8581:1869977659401088:0@lo:502: 00000040:00080000:2.0:1783349761.006721:0:8581:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:0.0:1783349761.006760:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659400832 00000100:00100000:0.0:1783349761.006766:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659400832 00000100:00100000:0.0:1783349761.006812:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349761.006822:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8580:x1869977659400832:12345-0@lo:700: 00000100:00100000:0.0:1783349761.006857:0:8440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8440:1869977659401216:0@lo:700: 00000100:00100000:0.0:1783349761.006893:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349761.006922:0:8440:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349761.006933:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659401216 00000100:00100000:2.0:1783349761.006938:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659401216 00000100:00080000:0.0:1783349761.006938:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349761.006967:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349761.006974:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8440:x1869977659401216:12345-0@lo:700: 00000020:01000000:0.0:1783349761.007446:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783349761.007468:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783349761.007477:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.008345:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349761.008363:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783349761.008365:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea3461c1000 from 5 10000000:01000000:0.0:1783349761.008368:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783349761.008407:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.008416:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.008425:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349761.008445:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659401344:0@lo:101: 00000100:00100000:0.0:1783349761.008798:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349761.008843:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508c1540 going to sleep for 11 seconds 00000100:00100000:2.0:1783349761.008968:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659401344 00000100:00100000:2.0:1783349761.008975:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659401344 00000100:00100000:2.0:1783349761.009031:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783349761.009041:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659401344:12345-0@lo:101: 00010000:00010000:2.0:1783349761.009054:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349761.009067:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cce00/0xd05e6ae1590e1ea8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1ea1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349761.009094:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cce00/0xd05e6ae1590e1ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1ea1 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349761.009103:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cce00/0xd05e6ae1590e1ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1ea1 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349761.009123:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cce00, rc 0) 00000100:00100000:2.0:1783349761.009184:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659401344:12345-0@lo:101: Request processed in 146us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349761.009192:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783349761.009964:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659401344:0@lo:101: 00010000:00010000:0.0:1783349761.009985:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.009995:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349761.010058:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659401472:0@lo:256: 00000100:00100000:0.0:1783349761.010102:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349761.011526:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659401472 00000100:00100000:2.0:1783349761.011536:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659401472 00000100:00100000:3.0:1783349761.011715:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783349761.011728:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659401472:12345-0@lo:256: 20000000:01000000:3.0:1783349761.011751:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000100:00100000:0.0:1783349761.011765:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508c1540 going to sleep for 11 seconds 20000000:01000000:3.0:1783349761.011772:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783349761.011777:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1783349761.011905:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659401472:12345-0@lo:256: Request processed in 180us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349761.011962:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659401472:0@lo:256: 10000000:01000000:0.0:1783349761.012014:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783349761.012025:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.012036:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349761.012044:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783349761.012047:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1783349761.012050:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783349761.012075:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.012084:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.012103:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349761.012120:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659401600:0@lo:101: 00000100:00100000:0.0:1783349761.012779:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349761.012821:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349761.012835:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659401600 00000100:00100000:1.0:1783349761.012843:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659401600 00000100:00100000:3.0:1783349761.017245:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783349761.017361:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783349761.017378:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659401600:12345-0@lo:101: 00010000:00010000:1.0:1783349761.017397:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349761.017415:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e1eb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1eaf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349761.017444:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e1eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1eaf expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349761.017455:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e1eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1eaf expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349761.017464:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d600, rc 0) 00000100:00100000:1.0:1783349761.017556:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659401600:12345-0@lo:101: Request processed in 185us (4778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.017562:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783349761.017676:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659401600:0@lo:101: 00010000:00010000:3.0:1783349761.017697:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349761.017714:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349761.017926:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659401728:0@lo:501: 00000100:00100000:3.0:1783349761.017963:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349761.018001:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9480 going to sleep for 11 seconds 00000100:00100000:1.0:1783349761.018075:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659401728 00000100:00100000:1.0:1783349761.018082:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659401728 00000100:00100000:1.0:1783349761.018121:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783349761.018128:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659401728:12345-0@lo:501: 00000100:00100000:1.0:1783349761.018254:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659401728:12345-0@lo:501: Request processed in 125us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.018260:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783349761.018922:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659401728:0@lo:501: 00000100:00100000:3.0:1783349761.018962:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659401856:0@lo:503: 00000100:00100000:3.0:1783349761.019010:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349761.019042:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9480 going to sleep for 11 seconds 00000100:00100000:1.0:1783349761.019075:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659401856 00000100:00100000:1.0:1783349761.019081:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659401856 00000100:00100000:1.0:1783349761.019117:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783349761.019124:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659401856:12345-0@lo:503: 00000100:00100000:1.0:1783349761.019237:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659401856:12345-0@lo:503: Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.019243:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783349761.020730:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659401856:0@lo:503: 40000000:02000000:2.0:1783349761.020980:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1783349761.031453:0:8583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8583:1869977659401984:0@lo:502: 00000100:00100000:0.0:1783349761.031530:0:8583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349761.031596:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659401984 00000100:00100000:3.0:1783349761.031612:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659401984 00000100:00100000:3.0:1783349761.031665:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783349761.031675:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:8583:x1869977659401984:12345-0@lo:502: 00000100:00100000:0.0:1783349761.031708:0:8583:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349761.032392:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8440:x1869977659401216:12345-0@lo:700: Request processed in 25415us (25494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349761.032402:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349761.032521:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:8583:x1869977659401984:12345-0@lo:502: Request processed in 846us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349761.032530:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:0.0:1783349761.032572:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea370d64380 x1869977659401216/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783349777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349761.032588:0:8440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8440:1869977659401216:0@lo:700: 40000000:02000000:0.0:1783349761.032727:0:8440:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:2.0:1783349761.033818:0:8583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8583:1869977659401984:0@lo:502: 00000020:01000000:2.0:1783349761.033865:0:8583:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783349761.033873:0:8583:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783349761.033881:0:8583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349761.033883:0:8583:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783349761.033887:0:8583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783349761.033891:0:8583:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:2.0:1783349761.033914:0:8583:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783349761.033918:0:8583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783349761.033936:0:8583:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ea24244b380) 00000020:00000080:2.0:1783349761.033959:0:8583:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783349761.033965:0:8583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783349761.034049:0:8583:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783349761.034057:0:8583:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783349761.034064:0:8583:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e1ec4 00010000:00080000:2.0:1783349761.034098:0:8583:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea24271c000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1783349761.034358:0:8583:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:3.0:1783349761.044906:0:8583:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783349761.044931:0:8583:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783349761.045133:0:8583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783349761.045379:0:8583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783349761.045464:0:8583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783349761.045550:0:8583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783349761.046362:0:8584:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349761.046368:0:8584:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783349761.048285:0:8583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783349761.048300:0:8583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783349761.048341:0:8583:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783349761.048365:0:8583:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e1ecb 00000100:00080000:0.0:1783349761.048377:0:8583:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783349761.048383:0:8583:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ea24271c000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349761.048417:0:8583:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36cce8380 x1869977659402112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783349761.048446:0:8583:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783349761.048519:0:8583:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349761.048528:0:8583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349761.048530:0:8583:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783349761.048533:0:8583:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349761.048538:0:8583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349761.048539:0:8583:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783349761.048542:0:8583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783349761.048544:0:8583:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783349761.048573:0:8583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8583:1869977659402240:0@lo:502: 00000100:00100000:3.0:1783349761.048649:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659402112:0@lo:8: 00000100:00100000:3.0:1783349761.048737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349761.049824:0:8583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349761.049868:0:8583:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349761.049881:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659402240 00000100:00100000:3.0:1783349761.049901:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659402240 00000100:00100000:3.0:1783349761.049962:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783349761.049972:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:8583:x1869977659402240:12345-0@lo:502: 00000100:00100000:3.0:1783349761.050093:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:8583:x1869977659402240:12345-0@lo:502: Request processed in 123us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349761.050101:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783349761.050735:0:8583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:8583:1869977659402240:0@lo:502: 00000020:01000000:0.0:1783349761.050768:0:8583:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349761.050775:0:8583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349761.050777:0:8583:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783349761.050781:0:8583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1783349761.051190:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1783349761.051218:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783349761.051232:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349761.051243:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349761.051256:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783349761.051259:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ea349f8b380 from 1 10000000:01000000:3.0:1783349761.051262:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783349761.051296:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349761.051304:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349761.051313:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349761.051333:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659402368:0@lo:101: 00000100:00100000:3.0:1783349761.051385:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349761.051422:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349761.052108:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659402112 00000100:00100000:2.0:1783349761.052116:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659402112 00000100:00100000:2.0:1783349761.052166:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349761.052173:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1869977659402112:12345-0@lo:8: 00010000:00080000:2.0:1783349761.052197:0:8433:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1783349761.052222:0:8433:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e1ed9 00002000:00100000:2.0:1783349761.052237:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ea24271e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783349761.052241:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783349761.052244:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783349761.052306:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783349761.052330:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8ea24271f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783349761.052387:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869977659402112:12345-0@lo:8: Request processed in 214us (3651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349761.052395:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783349761.052619:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659402368 00000100:00100000:0.0:1783349761.052633:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659402368 00000100:00100000:0.0:1783349761.052665:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783349761.052671:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659402368:12345-0@lo:101: 00010000:00010000:0.0:1783349761.052681:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349761.052695:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1ed2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.052716:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1ed2 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.052725:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1ed2 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.052734:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8fc00, rc 0) 00000100:00100000:0.0:1783349761.052771:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659402368:12345-0@lo:101: Request processed in 100us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349761.052777:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783349761.052824:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659402368:0@lo:101: 00010000:00010000:0.0:1783349761.052837:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.052900:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349761.052960:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659402496:0@lo:501: 00000100:00100000:0.0:1783349761.052985:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349761.053007:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349761.053018:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659402496 00000100:00100000:0.0:1783349761.053021:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659402496 00000100:00100000:0.0:1783349761.053039:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783349761.053044:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659402496:12345-0@lo:501: 00010000:00080000:3.0:1783349761.053107:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cce8380 x1869977659402112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783349771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349761.053110:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659402496:12345-0@lo:501: Request processed in 64us (123us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349761.053120:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783349761.053131:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1783349761.053175:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659402496:0@lo:501: 00000100:00080000:3.0:1783349761.053195:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783349761.053205:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 10000000:01000000:0.0:1783349761.053210:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00000100:00080000:3.0:1783349761.053211:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783349761.053217:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00010000:0.0:1783349761.053220:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349761.053229:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783349761.053233:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783349761.053240:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659402112:0@lo:8: 00000004:00080000:1.0:1783349761.053812:0:8584:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000001:00100000:3.0:1783349761.054257:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1783349761.054567:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8580:x1869977659400832:12345-0@lo:700: Request processed in 47743us (50038us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349761.054595:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783349761.055064:0:8580:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cf4c700 x1869977659400832/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783349777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349761.055077:0:8580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8580:1869977659400832:0@lo:700: 00000004:00080000:1.0:1783349761.055518:0:8584:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 201850380208ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783349761.055525:0:8584:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1783349761.056083:0:8585:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783349761.056105:0:8585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8585:1869977659402752:0@lo:7: 00000100:00100000:3.0:1783349761.056183:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349761.056214:0:8585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9840 going to sleep for 11 seconds 00000100:00100000:2.0:1783349761.056272:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659402624:0@lo:13: 00000100:00100000:2.0:1783349761.056305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349761.056394:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659402752 00000100:00100000:1.0:1783349761.056402:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659402752 00000100:00100000:1.0:1783349761.056467:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783349761.056477:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8585:x1869977659402752:12345-0@lo:7: 00000100:00080000:2.0:1783349761.057966:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349761.058287:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659402624 00000100:00100000:3.0:1783349761.058295:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659402624 00000100:00100000:3.0:1783349761.058398:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349761.058408:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659402624:12345-0@lo:13: 00002000:00000024:3.0:1783349761.058443:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923902464 avail 3692380160 00000100:00100000:3.0:1783349761.058521:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659402624:12345-0@lo:13: Request processed in 115us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349761.058528:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783349761.059419:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da5180 x1869977659402624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349761.059444:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659402624:0@lo:13: 00000004:00080000:2.0:1783349761.061273:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1783349761.063124:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1783349761.063159:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1783349761.063255:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8585:x1869977659402752:12345-0@lo:7: Request processed in 6776us (7068us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.063266:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783349761.063519:0:8585:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da6300 x1869977659402752/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783349777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349761.063547:0:8585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8585:1869977659402752:0@lo:7: 00000004:00080000:3.0:1783349761.063561:0:8585:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1783349761.063598:0:8585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8585:1869977659402880:0@lo:5: 00000100:00100000:3.0:1783349761.063644:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349761.063671:0:8585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9840 going to sleep for 11 seconds 00000100:00100000:2.0:1783349761.063861:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659402880 00000100:00100000:2.0:1783349761.063868:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659402880 00000100:00100000:2.0:1783349761.063915:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349761.063930:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8585:x1869977659402880:12345-0@lo:5: 00002000:00080000:2.0:1783349761.063957:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783349761.063960:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000004:00080000:0.0:1783349761.066052:0:8580:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783349761.066084:0:8580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8580:1869977659403136:0@lo:7: 00000100:00100000:0.0:1783349761.066164:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349761.066199:0:8580:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349761.066215:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659403008:0@lo:13: 00000100:00100000:0.0:1783349761.066239:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349761.067306:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659403008 00000100:00100000:2.0:1783349761.067320:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659403008 00000100:00100000:2.0:1783349761.067368:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349761.067377:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659403008:12345-0@lo:13: 00002000:00000024:2.0:1783349761.067401:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923902464 avail 3692380160 00000100:00100000:2.0:1783349761.067464:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659403008:12345-0@lo:13: Request processed in 87us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349761.067470:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783349761.067507:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cce8e00 x1869977659403008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349761.067526:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659403008:0@lo:13: 00000001:00080000:2.0:1783349761.067665:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1783349761.067675:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783349761.067737:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8585:x1869977659402880:12345-0@lo:5: Request processed in 3808us (4092us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783349761.067745:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349761.067756:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659403136 00000100:00100000:2.0:1783349761.067760:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659403136 00000100:00100000:2.0:1783349761.067781:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783349761.067788:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8580:x1869977659403136:12345-0@lo:7: 00002000:00080000:2.0:1783349761.074413:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1783349761.074423:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783349761.074521:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8580:x1869977659403136:12345-0@lo:7: Request processed in 6729us (8352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349761.074540:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783349761.074716:0:8580:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cce8a80 x1869977659403136/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783349777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349761.074732:0:8580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8580:1869977659403136:0@lo:7: 00000004:00080000:0.0:1783349761.074744:0:8580:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783349761.074780:0:8580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8580:1869977659403264:0@lo:5: 00000100:00100000:0.0:1783349761.074814:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349761.074844:0:8580:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d06c0 going to sleep for 11 seconds 00010000:00080000:0.0:1783349761.075206:0:8585:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da6300 x1869977659402880/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349761.075216:0:8585:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783349761.075221:0:8585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8585:1869977659402880:0@lo:5: 00000004:00080000:0.0:1783349761.075230:0:8585:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783349761.075262:0:8585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8585:1869977659403392:0@lo:700: 00000100:00100000:0.0:1783349761.075288:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349761.075313:0:8585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508c13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349761.075354:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659403392 00000100:00100000:1.0:1783349761.075362:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659403392 00000100:00100000:1.0:1783349761.075413:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349761.075423:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8585:x1869977659403392:12345-0@lo:700: 00000100:00100000:2.0:1783349761.075468:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659403264 00000100:00100000:2.0:1783349761.075472:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659403264 00000100:00100000:2.0:1783349761.075533:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783349761.075541:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8580:x1869977659403264:12345-0@lo:5: 00002000:00080000:2.0:1783349761.075562:0:8432:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1783349761.075618:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8580:x1869977659403264:12345-0@lo:5: Request processed in 69us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349761.075634:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783349761.075721:0:8580:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cce8a80 x1869977659403264/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349761.075731:0:8580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8580:1869977659403264:0@lo:5: 00000004:00080000:1.0:1783349761.075749:0:8580:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783349761.075775:0:8580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8580:1869977659403520:0@lo:5: 00000100:00100000:1.0:1783349761.075802:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349761.085952:0:8580:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227180 going to sleep for 11 seconds 00000100:00100000:0.0:1783349761.089126:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659403520 00000100:00100000:0.0:1783349761.089151:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659403520 00000100:00100000:0.0:1783349761.089214:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349761.089225:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8580:x1869977659403520:12345-0@lo:5: 00002000:00080000:0.0:1783349761.089270:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1783349761.090977:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8580:x1869977659403520:12345-0@lo:5: Request processed in 1749us (15169us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783349761.090989:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783349761.093855:0:8580:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea370df6d80 x1869977659403520/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349761.093876:0:8580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8580:1869977659403520:0@lo:5: 00000004:00080000:1.0:1783349761.093891:0:8580:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1783349761.093933:0:8580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8580:1869977659403648:0@lo:900: 00000100:00100000:1.0:1783349761.093990:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349761.094014:0:8580:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227180 going to sleep for 11 seconds 00000100:00100000:3.0:1783349761.094298:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659403648 00000100:00100000:3.0:1783349761.094306:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659403648 00000100:00100000:3.0:1783349761.094354:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349761.094363:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8580:x1869977659403648:12345-0@lo:900: 00000100:00100000:3.0:1783349761.094424:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8580:x1869977659403648:12345-0@lo:900: Request processed in 62us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349761.094431:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783349761.094467:0:8580:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea370df4700 x1869977659403648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783349777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349761.094476:0:8580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8580:1869977659403648:0@lo:900: 00000001:00080000:0.0:1783349761.101218:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1783349761.101521:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8585:x1869977659403392:12345-0@lo:700: Request processed in 26094us (26226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349761.101532:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783349761.101662:0:8585:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cce9180 x1869977659403392/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783349777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349761.101677:0:8585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8585:1869977659403392:0@lo:700: 00000004:02000040:3.0:1783349761.104472:0:8585:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1783349761.110966:0:8585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8585:1869977659403776:0@lo:5: 00000100:00100000:2.0:1783349761.111035:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349761.112238:0:8585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349761.113033:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659403776 00000100:00100000:0.0:1783349761.113044:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659403776 00000100:00100000:0.0:1783349761.113096:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783349761.113104:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8585:x1869977659403776:12345-0@lo:5: 00002000:00080000:1.0:1783349761.121193:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1783349761.121219:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1783349761.124093:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8585:x1869977659403776:12345-0@lo:5: Request processed in 10983us (13052us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783349761.124106:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783349761.124313:0:8585:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cf4f800 x1869977659403776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349761.124331:0:8585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8585:1869977659403776:0@lo:5: 00000004:00080000:0.0:1783349761.124346:0:8585:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1783349761.668298:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349762.707207:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349763.463093:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659403904:0@lo:41: 00000100:00100000:0.0:1783349763.463189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349763.463279:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659403904 00000100:00100000:0.0:1783349763.463286:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659403904 00000100:00100000:0.0:1783349763.463326:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783349763.463333:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659403904:12345-0@lo:41: 00000004:00000024:0.0:1783349763.463363:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1783349763.463405:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659403904:12345-0@lo:41: Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349763.463419:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783349763.463459:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659403904:0@lo:41: 00010000:00010000:3.0:1783349763.720669:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783349764.607617:0:8808:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783349764.741546:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349764.996831:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349764.996862:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659404032:0@lo:41: 00000100:00100000:1.0:1783349764.996939:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349764.997017:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659404032 00000100:00100000:1.0:1783349764.997024:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659404032 00000100:00100000:1.0:1783349764.997076:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783349764.997086:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659404032:12345-0@lo:41: 00000004:00000024:1.0:1783349764.997122:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783349764.997197:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659404032:12345-0@lo:41: Request processed in 113us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349764.997205:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783349764.997341:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659404032:0@lo:41: 00000020:00000004:3.0:1783349765.308499:0:8860:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783349765.308728:0:8860:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783349765.766391:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783349765.953867:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1783349766.532482:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659404160:0@lo:400: 00000100:00100000:3.0:1783349766.532548:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659404544:0@lo:400: 00000100:00100000:0.0:1783349766.532575:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659404416:0@lo:400: 00000100:00100000:2.0:1783349766.532597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349766.532727:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659404160 00000100:00100000:0.0:1783349766.532765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349766.532780:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659404160 00000100:00100000:2.0:1783349766.532789:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659404800:0@lo:400: 00000100:00100000:0.0:1783349766.532794:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659404928:0@lo:400: 00000100:00100000:0.0:1783349766.532826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349766.532841:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349766.532855:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659405440:0@lo:13: 00000100:00100000:1.0:1783349766.532857:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783349766.532870:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659405184:0@lo:400: 00000100:00100000:0.0:1783349766.532891:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349766.532906:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349766.532914:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:3649:x1869977659404160:12345-0@lo:400: 00000100:00100000:0.0:1783349766.532915:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783349766.532927:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659404288:0@lo:400: 00000100:00100000:2.0:1783349766.532931:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349766.532940:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659405056:0@lo:400: 00000100:00100000:0.0:1783349766.532965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349766.532982:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659404672:0@lo:13: 00000100:00100000:2.0:1783349766.533111:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659404416 00000100:00100000:2.0:1783349766.533116:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659404416 00000100:00100000:2.0:1783349766.533174:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659404800 00000100:00100000:2.0:1783349766.533177:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659404800 00000100:00100000:2.0:1783349766.533193:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349766.533199:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659404416:12345-0@lo:400: 00000100:00100000:3.0:1783349766.533220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349766.533683:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659404416:12345-0@lo:400: Request processed in 481us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349766.533692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349766.533712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783349766.533718:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659404800:12345-0@lo:400: 00000100:00100000:2.0:1783349766.533750:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659404800:12345-0@lo:400: Request processed in 32us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349766.533756:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783349766.533781:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659405440 00000100:00100000:2.0:1783349766.533785:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659405440 00000100:00100000:2.0:1783349766.534068:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349766.534076:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659405440:12345-0@lo:13: 00002000:00000024:2.0:1783349766.534101:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349766.534157:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659405440:12345-0@lo:13: Request processed in 60us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349766.534163:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349766.534186:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659404928 00000100:00100000:2.0:1783349766.534189:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659404928 00000100:00100000:2.0:1783349766.534301:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659404288 00000100:00100000:2.0:1783349766.534305:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659404288 00000100:00100000:2.0:1783349766.534318:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659404544 00000100:00100000:2.0:1783349766.534321:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659404544 00000100:00100000:2.0:1783349766.534333:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783349766.534341:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659404928:12345-0@lo:400: 00000100:00100000:2.0:1783349766.534396:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659404928:12345-0@lo:400: Request processed in 54us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349766.534403:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783349766.534424:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349766.534425:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:3649:x1869977659404160:12345-0@lo:400: Request processed in 1537us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349766.534434:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659404288:12345-0@lo:400: 00000100:00100000:1.0:1783349766.534436:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783349766.534449:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349766.534482:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659404288:12345-0@lo:400: Request processed in 50us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349766.534484:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783349766.534487:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659405312:0@lo:400: 00000100:00100000:2.0:1783349766.534499:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349766.534500:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659404544:12345-0@lo:400: 00000100:00100000:0.0:1783349766.534522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783349766.534524:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349766.534530:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349766.534548:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659404544:12345-0@lo:400: Request processed in 54us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349766.534555:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1783349766.534562:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea370df7480 x1869977659405440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349766.534570:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1783349766.534577:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659405184 00000100:00100000:1.0:1783349766.534592:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659405184 00000100:00100000:0.0:1783349766.534601:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659405440:0@lo:13: 00000100:00100000:1.0:1783349766.534624:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659405312 00000100:00100000:0.0:1783349766.534624:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659404416:0@lo:400: 00000100:00100000:1.0:1783349766.534633:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659405312 00000100:00100000:1.0:1783349766.534648:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349766.534654:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659405184:12345-0@lo:400: 00000100:00100000:1.0:1783349766.534682:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659405184:12345-0@lo:400: Request processed in 28us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349766.534688:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349766.534696:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349766.534701:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659405312:12345-0@lo:400: 00000100:00100000:1.0:1783349766.534719:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659405312:12345-0@lo:400: Request processed in 18us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349766.534724:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349766.534758:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659404672 00000100:00100000:1.0:1783349766.534761:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659404672 00000100:00080000:2.0:1783349766.534784:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349766.534787:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783349766.534794:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659404672:12345-0@lo:13: 00002000:00000024:1.0:1783349766.534805:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1783349766.534810:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbbb100 x1869977659404928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349766.534822:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659404928:0@lo:400: 00000100:00100000:1.0:1783349766.534833:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659404672:12345-0@lo:13: Request processed in 37us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349766.534840:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783349766.534869:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cceb800 x1869977659404288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349766.534879:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659404288:0@lo:400: 00000100:00100000:2.0:1783349766.534885:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783349766.534895:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da7800 x1869977659404672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349766.534903:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783349766.534913:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659404672:0@lo:13: 00010000:00080000:0.0:1783349766.534922:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbbbb80 x1869977659405312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349766.534929:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659405312:0@lo:400: 00000100:00100000:2.0:1783349766.534979:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659404800:0@lo:400: 00010000:00080000:2.0:1783349766.534992:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbb8700 x1869977659405184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349766.535002:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659405184:0@lo:400: 00000100:00100000:2.0:1783349766.535011:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659404160:0@lo:400: 00000100:00100000:1.0:1783349766.535062:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659405056 00000100:00100000:1.0:1783349766.535066:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659405056 00000100:00100000:1.0:1783349766.535192:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783349766.535199:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659405056:12345-0@lo:400: 00000100:00100000:1.0:1783349766.535248:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659405056:12345-0@lo:400: Request processed in 50us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349766.535255:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1783349766.535380:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1783349766.535403:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbb9f80 x1869977659405056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349766.535414:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659405056:0@lo:400: 00010000:00080000:3.0:1783349766.537578:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cce8a80 x1869977659404544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349766.537607:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659404544:0@lo:400: 00010000:00010000:3.0:1783349766.794098:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349767.814187:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783349767.826338:0:8962:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783349767.826552:0:8962:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1783349768.554453:0:9010:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783349768.554463:0:9010:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1783349768.580304:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349768.580941:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659405568:0@lo:41: 00000100:00100000:2.0:1783349768.581328:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349768.581611:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659405568 00000100:00100000:0.0:1783349768.581621:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659405568 00000100:00100000:0.0:1783349768.581679:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783349768.581690:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659405568:12345-0@lo:41: 00000004:00000024:0.0:1783349768.581726:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1783349768.581782:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659405568:12345-0@lo:41: Request processed in 94us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349768.581801:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783349768.581861:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659405568:0@lo:41: 00010000:00010000:3.0:1783349768.836977:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349769.860519:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349770.123836:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659405696:0@lo:41: 00000100:00100000:1.0:1783349770.123907:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349770.123978:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659405696 00000100:00100000:1.0:1783349770.123986:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659405696 00000100:00100000:1.0:1783349770.124032:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783349770.124041:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659405696:12345-0@lo:41: 00000004:00000024:1.0:1783349770.124076:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783349770.124117:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659405696:12345-0@lo:41: Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349770.124125:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783349770.124187:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659405696:0@lo:41: 00010000:00010000:0.0:1783349770.884308:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349771.653931:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659405952:0@lo:400: 00000100:00100000:0.0:1783349771.654006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349771.654061:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659406464:0@lo:400: 00000100:00100000:0.0:1783349771.654105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349771.654132:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783349771.654163:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659405824:0@lo:400: 00000100:00100000:0.0:1783349771.654195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349771.654217:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659406336:0@lo:400: 00000100:00100000:0.0:1783349771.654241:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349771.654261:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659406848:0@lo:400: 00000100:00100000:0.0:1783349771.654283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349771.654311:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659405824 00000100:00100000:0.0:1783349771.654319:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659405824 00000100:00100000:0.0:1783349771.654365:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783349771.654373:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:3647:x1869977659405824:12345-0@lo:400: 00000100:00100000:0.0:1783349771.654426:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:3647:x1869977659405824:12345-0@lo:400: Request processed in 53us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349771.654433:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783349771.654464:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659406336 00000100:00100000:0.0:1783349771.654469:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659406336 00000100:00100000:0.0:1783349771.654492:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783349771.654499:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659406336:12345-0@lo:400: 00000100:00100000:3.0:1783349771.654518:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659406080:0@lo:400: 00000100:00100000:0.0:1783349771.654534:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659406336:12345-0@lo:400: Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349771.654541:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783349771.654571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349771.654576:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659406976:0@lo:13: 00000100:00100000:3.0:1783349771.654599:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659406592:0@lo:400: 00000100:00100000:0.0:1783349771.654609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349771.654633:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349771.654652:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659405824:0@lo:400: 00000100:00100000:3.0:1783349771.654660:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783349771.654669:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659406336:0@lo:400: 00000100:00100000:3.0:1783349771.654670:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659406208:0@lo:400: 00000100:00100000:3.0:1783349771.654694:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349771.654714:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659406976 00000100:00100000:3.0:1783349771.654715:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659406720:0@lo:400: 00000100:00100000:0.0:1783349771.654720:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659406976 00000100:00100000:3.0:1783349771.654741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349771.654762:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783349771.654772:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659406976:12345-0@lo:13: 00000100:00100000:3.0:1783349771.654774:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659406080 00000100:00100000:3.0:1783349771.654780:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659406080 00002000:00000024:0.0:1783349771.654795:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349771.654823:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783349771.654833:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659406080:12345-0@lo:400: 00000100:00100000:0.0:1783349771.654839:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659406976:12345-0@lo:13: Request processed in 68us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349771.654847:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1783349771.654865:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349771.654882:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659406080:12345-0@lo:400: Request processed in 49us (311us total) trans 0 rc 0/0 00010000:00080000:0.0:1783349771.654888:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da7b80 x1869977659406976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349771.654893:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783349771.654906:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659406976:0@lo:13: 00000100:00100000:3.0:1783349771.654935:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659405952 00000100:00100000:3.0:1783349771.654938:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659405952 00000100:00100000:3.0:1783349771.654954:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659406464 00000100:00100000:3.0:1783349771.654962:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659406464 00000100:00100000:3.0:1783349771.654987:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659406592 00000100:00100000:3.0:1783349771.654989:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659406592 00000100:00100000:3.0:1783349771.654999:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659406208 00000100:00100000:3.0:1783349771.655001:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659406208 00000100:00100000:3.0:1783349771.655012:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783349771.655017:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659405952:12345-0@lo:400: 00000100:00100000:3.0:1783349771.655050:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659405952:12345-0@lo:400: Request processed in 33us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349771.655055:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783349771.655066:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783349771.655071:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659406464:12345-0@lo:400: 00000100:00100000:3.0:1783349771.655093:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659406464:12345-0@lo:400: Request processed in 22us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349771.655098:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783349771.655107:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783349771.655112:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659406592:12345-0@lo:400: 00000100:00100000:3.0:1783349771.655131:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659406592:12345-0@lo:400: Request processed in 19us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349771.655168:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783349771.655178:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783349771.655184:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659406208:12345-0@lo:400: 00000100:00100000:3.0:1783349771.655208:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659406208:12345-0@lo:400: Request processed in 24us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349771.655213:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783349771.655233:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659406848 00000100:00100000:3.0:1783349771.655236:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659406848 00000100:00100000:3.0:1783349771.655263:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659406720 00000100:00100000:3.0:1783349771.655266:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659406720 00000100:00100000:3.0:1783349771.655275:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783349771.655291:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659406848:12345-0@lo:400: 00000100:00100000:3.0:1783349771.655318:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659406848:12345-0@lo:400: Request processed in 37us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349771.655322:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783349771.655331:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783349771.655337:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659406720:12345-0@lo:400: 00000100:00100000:3.0:1783349771.655356:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659406720:12345-0@lo:400: Request processed in 20us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349771.655361:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783349771.655785:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbbaa00 x1869977659406208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349771.655796:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659406208:0@lo:400: 00010000:00080000:3.0:1783349771.655868:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbbb480 x1869977659406720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349771.655877:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659406720:0@lo:400: 00000100:00100000:3.0:1783349771.655887:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659406080:0@lo:400: 00010000:00080000:3.0:1783349771.656089:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbb8a80 x1869977659406592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349771.656099:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659406592:0@lo:400: 00010000:00080000:3.0:1783349771.656218:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbb8380 x1869977659406848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349771.656228:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659406848:0@lo:400: 00010000:00080000:3.0:1783349771.656249:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbbb100 x1869977659405952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349771.656257:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659405952:0@lo:400: 00010000:00080000:3.0:1783349771.656267:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbbad80 x1869977659406464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349771.656275:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659406464:0@lo:400: 00000100:00080000:0.0:1783349771.656978:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349771.656984:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349771.656986:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349771.657027:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349771.657043:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659407104:0@lo:13: 00000100:00100000:1.0:1783349771.657099:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349771.657189:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659407104 00000100:00100000:1.0:1783349771.657196:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659407104 00000100:00100000:1.0:1783349771.657229:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783349771.657237:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659407104:12345-0@lo:13: 00002000:00000024:1.0:1783349771.657258:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349771.657354:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659407104:12345-0@lo:13: Request processed in 118us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349771.657362:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783349771.657375:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea370df6300 x1869977659407104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349771.657391:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659407104:0@lo:13: 00010000:00010000:0.0:1783349771.910716:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349772.936424:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349773.705686:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659407232:0@lo:41: 00000100:00100000:3.0:1783349773.705772:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349773.705957:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659407232 00000100:00100000:1.0:1783349773.705968:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659407232 00000100:00100000:1.0:1783349773.706034:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783349773.706043:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659407232:12345-0@lo:41: 00000004:00000024:1.0:1783349773.706078:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783349773.706160:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659407232:12345-0@lo:41: Request processed in 117us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349773.706167:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783349773.706320:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659407232:0@lo:41: 00010000:00010000:3.0:1783349773.956303:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349774.982848:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349775.236572:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659407360:0@lo:41: 00000100:00100000:2.0:1783349775.236642:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349775.236797:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659407360 00000100:00100000:3.0:1783349775.236806:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659407360 00000100:00100000:3.0:1783349775.236862:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783349775.236872:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659407360:12345-0@lo:41: 00000004:00000024:3.0:1783349775.236907:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1783349775.237233:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659407360:12345-0@lo:41: Request processed in 310us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349775.237241:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783349775.237550:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659407360:0@lo:41: 00010000:00010000:3.0:1783349776.008341:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349776.772487:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659407488:0@lo:400: 00000100:00100000:3.0:1783349776.772577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.772620:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659408000:0@lo:400: 00000100:00100000:3.0:1783349776.772645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.772664:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659408512:0@lo:400: 00000100:00100000:3.0:1783349776.772687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.772710:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783349776.772848:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659407488 00000100:00100000:1.0:1783349776.772856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659407488 00000100:00100000:1.0:1783349776.772901:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783349776.772912:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:3647:x1869977659407488:12345-0@lo:400: 00000100:00100000:1.0:1783349776.772963:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:3647:x1869977659407488:12345-0@lo:400: Request processed in 53us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349776.772970:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783349776.773083:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659407872:0@lo:400: 00000100:00100000:3.0:1783349776.773113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.773161:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659408384:0@lo:400: 00000100:00100000:3.0:1783349776.773182:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.773211:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659407488:0@lo:400: 00000100:00100000:3.0:1783349776.773238:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659407616:0@lo:400: 00000100:00100000:3.0:1783349776.773261:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.773278:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659408128:0@lo:400: 00000100:00100000:3.0:1783349776.773297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.773311:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659408640:0@lo:13: 00000100:00100000:3.0:1783349776.773331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.773346:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783349776.773352:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659407744:0@lo:400: 00000100:00100000:3.0:1783349776.773373:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.773392:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659408256:0@lo:400: 00000100:00100000:3.0:1783349776.773412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.773425:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659408768:0@lo:13: 00000100:00100000:3.0:1783349776.773444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349776.773484:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659408000 00000100:00100000:3.0:1783349776.773488:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659408000 00000100:00100000:3.0:1783349776.773523:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659407744 00000100:00100000:3.0:1783349776.773526:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659407744 00000100:00100000:3.0:1783349776.773540:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783349776.773546:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659408000:12345-0@lo:400: 00000100:00100000:3.0:1783349776.773593:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659408000:12345-0@lo:400: Request processed in 45us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349776.773599:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783349776.773612:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783349776.773618:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659407744:12345-0@lo:400: 00000100:00100000:3.0:1783349776.773649:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659407744:12345-0@lo:400: Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349776.773655:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783349776.773671:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659408512 00000100:00100000:3.0:1783349776.773674:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659408512 00000100:00100000:3.0:1783349776.773702:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659408384 00000100:00100000:3.0:1783349776.773706:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659408384 00000100:00100000:1.0:1783349776.773837:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659407872 00000100:00100000:1.0:1783349776.773841:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659407872 00000100:00100000:1.0:1783349776.773861:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659407616 00000100:00100000:1.0:1783349776.773864:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659407616 00000100:00100000:1.0:1783349776.773874:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659408128 00000100:00100000:1.0:1783349776.773877:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659408128 00000100:00100000:1.0:1783349776.773889:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659408256 00000100:00100000:1.0:1783349776.773891:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659408256 00000100:00100000:1.0:1783349776.773905:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349776.773911:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659407872:12345-0@lo:400: 00000100:00100000:1.0:1783349776.773943:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659407872:12345-0@lo:400: Request processed in 32us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349776.773949:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349776.773961:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349776.773967:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659407616:12345-0@lo:400: 00000100:00100000:1.0:1783349776.773993:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659407616:12345-0@lo:400: Request processed in 27us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349776.774000:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349776.774019:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783349776.774025:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659408128:12345-0@lo:400: 00000100:00100000:1.0:1783349776.774052:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659408128:12345-0@lo:400: Request processed in 28us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349776.774058:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783349776.774069:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783349776.774075:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659408256:12345-0@lo:400: 00000100:00100000:1.0:1783349776.774101:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659408256:12345-0@lo:400: Request processed in 27us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349776.774107:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783349776.774127:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659408640 00000100:00100000:1.0:1783349776.774131:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659408640 00000100:00100000:1.0:1783349776.774162:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659408768 00000100:00100000:1.0:1783349776.774165:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659408768 00000100:00100000:1.0:1783349776.774175:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783349776.774181:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869977659408640:12345-0@lo:13: 00002000:00000024:1.0:1783349776.774204:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349776.774234:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869977659408640:12345-0@lo:13: Request processed in 53us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349776.774240:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783349776.774251:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783349776.774258:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659408768:12345-0@lo:13: 00002000:00000024:1.0:1783349776.774267:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349776.774290:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659408768:12345-0@lo:13: Request processed in 33us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349776.774296:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783349776.774317:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783349776.774331:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659408512:12345-0@lo:400: 00000100:00100000:1.0:1783349776.774360:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659408512:12345-0@lo:400: Request processed in 31us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349776.774366:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349776.774852:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349776.774861:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659408384:12345-0@lo:400: 00000100:00100000:3.0:1783349776.774897:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659408384:12345-0@lo:400: Request processed in 38us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349776.774903:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783349776.775833:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48ca80 x1869977659407872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349776.775851:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659407872:0@lo:400: 00010000:00080000:3.0:1783349776.775867:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48f100 x1869977659408384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349776.775891:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659408384:0@lo:400: 00000100:00100000:3.0:1783349776.775903:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659408000:0@lo:400: 00010000:00080000:3.0:1783349776.775912:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48df80 x1869977659408512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349776.775920:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659408512:0@lo:400: 00000100:00100000:3.0:1783349776.775962:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659407744:0@lo:400: 00010000:00080000:3.0:1783349776.775973:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48dc00 x1869977659408256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349776.775982:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659408256:0@lo:400: 00010000:00080000:3.0:1783349776.775990:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea370df4700 x1869977659408768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349776.776003:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659408768:0@lo:13: 00010000:00080000:3.0:1783349776.776012:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48d500 x1869977659407616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349776.776019:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659407616:0@lo:400: 00010000:00080000:3.0:1783349776.776028:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48c380 x1869977659408128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349776.776036:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659408128:0@lo:400: 00010000:00080000:3.0:1783349776.776045:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea370df5500 x1869977659408640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349776.776055:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659408640:0@lo:13: 00000100:00080000:3.0:1783349776.776086:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349776.776090:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783349776.776093:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783349777.028310:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783349777.243638:0:9509:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783349777.243641:0:9509:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783349777.243642:0:9509:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783349777.243816:0:9509:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ea36d976000 00000020:01000004:2.0:1783349777.243832:0:9509:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783349777.243851:0:9509:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783349777.243864:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ea242448000) 00000020:00000080:2.0:1783349777.244070:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783349777.309638:0:9509:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783349777.309693:0:9509:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1783349777.332379:0:9509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783349777.332678:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783349777.332693:0:9509:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783349777.332703:0:9509:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd05e6ae1590e1eee 00000020:01000004:3.0:1783349777.332710:0:9509:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783349777.332731:0:9509:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783349777.332735:0:9509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783349777.332741:0:9509:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783349777.332769:0:9509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1783349777.332773:0:9509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783349777.356127:0:9509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783349777.356314:0:9509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.150@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1783349777.356319:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783349777.356321:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783349777.356322:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349777.356323:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349777.356324:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349777.356325:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349777.356327:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349777.356328:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349777.356329:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349777.356331:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349777.356332:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783349777.356336:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1783349777.356338:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783349777.356339:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783349777.356340:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349777.356341:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349777.356342:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349777.356343:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349777.356344:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349777.356350:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349777.356351:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349777.356352:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349777.356353:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783349777.356379:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783349777.356397:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659408896:0@lo:253: 00000100:00100000:3.0:1783349777.356476:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.356588:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3461e89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349777.356633:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659408896 00000100:00100000:1.0:1783349777.356641:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659408896 00000100:00100000:1.0:1783349777.356746:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783349777.356757:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:9509:x1869977659408896:12345-0@lo:253: 20000000:01000000:1.0:1783349777.356800:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783349777.356804:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1783349777.356810:0:6510:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1783349777.356813:0:6510:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1783349777.357399:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783349777.357555:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1783349777.357572:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1783349777.357591:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1783349777.357597:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1783349777.357610:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1783349777.357624:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1783349777.357721:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1783349777.357737:0:6510:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.150@tcp 20000000:01000000:1.0:1783349777.357739:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:1.0:1783349777.357766:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1783349777.357774:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783349777.357789:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1783349777.357794:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:1.0:1783349777.357805:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1783349777.357811:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783349777.357823:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1783349777.357837:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1783349777.358416:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1783349777.358434:0:6510:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.150@tcp 20000000:01000000:1.0:1783349777.358436:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:1.0:1783349777.358450:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1783349777.358457:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783349777.358471:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1783349777.358476:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:1.0:1783349777.358487:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1783349777.358492:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783349777.358516:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1783349777.358533:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1783349777.358918:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1783349777.358932:0:6510:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.150@tcp 20000000:01000000:1.0:1783349777.358933:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:1.0:1783349777.358948:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1783349777.358955:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783349777.358969:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1783349777.358975:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:1.0:1783349777.358989:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1783349777.358995:0:6510:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783349777.359009:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1783349777.359045:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1783349777.359060:0:6510:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783349777.359063:0:6510:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783349777.359067:0:6510:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783349777.359120:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783349777.359123:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783349777.359688:0:9515:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1783349777.359719:0:9515:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1783349777.359731:0:9515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1783349777.359932:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1783349777.359953:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1783349777.359968:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1783349777.359978:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783349777.359980:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783349777.360362:0:9516:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1783349777.360382:0:9516:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1783349777.360396:0:9516:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1783349777.360577:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1783349777.360600:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1783349777.360616:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1783349777.360626:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783349777.360628:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783349777.361081:0:9517:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1783349777.361429:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1783349777.361452:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1783349777.361466:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1783349777.361474:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783349777.361477:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783349777.362089:0:9518:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1783349777.362118:0:9518:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1783349777.362258:0:9518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1783349777.362441:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1783349777.362464:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1783349777.362478:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1783349777.362487:0:6510:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783349777.362490:0:6510:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783349777.362814:0:9519:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1783349777.362831:0:9519:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1783349777.362846:0:9519:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1783349777.363033:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1783349777.363053:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1783349777.363069:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:2.0:1783349777.363096:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783349777.363117:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363284:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e1deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1de4 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363294:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8e000/0xd05e6ae1590e1e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e0e expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363302:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e1e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e4d expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363310:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e1e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e69 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363316:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8c800/0xd05e6ae1590e1e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e93 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363322:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e1eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1eaf expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363329:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1ed2 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363336:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363379:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1ed2 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363395:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ed2 expref: 21 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349777.363420:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659409024:0@lo:104: 00000100:00100000:2.0:1783349777.363490:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349777.363580:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e1eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1eaf expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363588:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e1eb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1eaf expref: 21 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349777.363597:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659409152:0@lo:104: 00000100:00100000:2.0:1783349777.363618:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349777.363706:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8c800/0xd05e6ae1590e1e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1e93 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.363715:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36dd8c800/0xd05e6ae1590e1e9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e93 expref: 21 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349777.363723:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659409280:0@lo:104: 00000100:00100000:2.0:1783349777.363748:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349777.363809:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659409024 00000100:00100000:1.0:1783349777.363818:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659409024 00000100:00100000:1.0:1783349777.363858:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659409152 00000100:00100000:1.0:1783349777.363861:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659409152 00000100:00100000:1.0:1783349777.363876:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349777.363885:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6510:x1869977659409024:12345-0@lo:104: 00010000:00010000:1.0:1783349777.363898:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.363967:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783349777.363974:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6510:x1869977659409024:12345-0@lo:104: Request processed in 90us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.363981:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349777.363997:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349777.364003:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659409152:12345-0@lo:104: 00010000:00010000:1.0:1783349777.364009:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364044:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783349777.364049:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659409152:12345-0@lo:104: Request processed in 47us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.364062:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1783349777.364086:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349777.364091:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364099:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349777.364102:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364110:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349777.364116:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349777.364121:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349777.364170:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364177:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349777.364195:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364201:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1ed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1ee0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364215:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349777.364217:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364233:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fe00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349777.364235:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364241:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349777.364247:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349777.364251:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349777.364264:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364269:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349777.364273:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364279:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1eaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364287:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349777.364288:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349777.364290:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349777.364302:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659409408:0@lo:103: 00000100:00100000:1.0:1783349777.364330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349777.364355:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349777.364361:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659409536:0@lo:103: 00000100:00100000:1.0:1783349777.364393:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349777.364424:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659409408 00000100:00100000:1.0:1783349777.364428:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659409408 00010000:00010000:1.0:1783349777.364445:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1ee0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ed2 expref: 22 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349777.364465:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659409536 00000100:00100000:1.0:1783349777.364468:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659409536 00010000:00010000:1.0:1783349777.364479:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e1eb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1eaf expref: 23 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349777.364497:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349777.364517:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:3646:x1869977659409408:12345-0@lo:103: 00010000:00010000:1.0:1783349777.364539:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349777.364546:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1ee0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ed2 expref: 23 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364556:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ed2 expref: 23 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364571:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349777.364599:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:3646:x1869977659409408:12345-0@lo:103: Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.364605:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349777.364618:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349777.364625:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:3646:x1869977659409536:12345-0@lo:103: 00010000:00010000:1.0:1783349777.364632:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349777.364636:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e1eb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1eaf expref: 22 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364656:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e1eb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1eaf expref: 22 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.364666:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349777.364690:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:3646:x1869977659409536:12345-0@lo:103: Request processed in 66us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.364697:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349777.364738:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659409536:0@lo:103: 00000100:00100000:1.0:1783349777.364747:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659409408:0@lo:103: 00010000:00010000:3.0:1783349777.364820:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349777.365202:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659409280 00000100:00100000:1.0:1783349777.365208:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659409280 00000100:00100000:1.0:1783349777.365229:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783349777.365236:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659409280:12345-0@lo:104: 00010000:00010000:1.0:1783349777.365244:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.365284:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783349777.365289:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659409280:12345-0@lo:104: Request processed in 54us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.365295:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1783349777.365437:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349777.365443:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.365450:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:3.0:1783349777.365453:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.365461:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349777.365467:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349777.365472:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349777.365495:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.365513:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783349777.365554:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659409664:0@lo:103: 00000100:00100000:0.0:1783349777.365584:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349777.365626:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.365640:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e1e93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.365652:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349777.365653:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349777.365655:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349777.365679:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e1e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1e69 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.365689:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e1e70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e69 expref: 21 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.365698:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659409792:0@lo:104: 00000100:00100000:3.0:1783349777.365722:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349777.365744:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e1e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1e4d expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.365751:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e1e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e4d expref: 21 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.365760:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659409920:0@lo:104: 00000100:00100000:3.0:1783349777.365779:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349777.365802:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8e000/0xd05e6ae1590e1e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1e0e expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.365808:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36da8e000/0xd05e6ae1590e1e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e0e expref: 21 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.365816:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659410048:0@lo:104: 00000100:00100000:3.0:1783349777.365846:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349777.365864:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e1deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1de4 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.365871:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e1deb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1de4 expref: 21 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.365878:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659410176:0@lo:104: 00000100:00100000:3.0:1783349777.365892:0:6510:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66840 going to sleep for 11 seconds 00010000:00010000:3.0:1783349777.365922:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1ed2 expref: 21 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.365931:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659409024:0@lo:104: 00010000:00010000:3.0:1783349777.365942:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e1eb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1eaf expref: 20 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.365950:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659409152:0@lo:104: 00000100:00100000:3.0:1783349777.365957:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659409280:0@lo:104: 00000100:00100000:1.0:1783349777.366003:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659409664 00000100:00100000:1.0:1783349777.366008:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659409664 00010000:00010000:1.0:1783349777.366026:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8c800/0xd05e6ae1590e1e9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e93 expref: 20 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349777.366056:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783349777.366063:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:3648:x1869977659409664:12345-0@lo:103: 00010000:00010000:1.0:1783349777.366079:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349777.366085:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8c800/0xd05e6ae1590e1e9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e93 expref: 20 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.366094:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8c800/0xd05e6ae1590e1e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e93 expref: 20 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.366104:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8c800/0xd05e6ae1590e1e9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1e93 expref: 20 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.366114:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349777.366551:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3648:x1869977659409664:12345-0@lo:103: Request processed in 486us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.366559:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783349777.366681:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659409664:0@lo:103: 00000100:00100000:0.0:1783349777.366715:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783349777.366733:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349777.366742:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659409792 00000100:00100000:0.0:1783349777.366745:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659409792 00000100:00100000:0.0:1783349777.366765:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659409920 00000100:00100000:0.0:1783349777.366768:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659409920 00000100:00100000:0.0:1783349777.366777:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659410048 00000100:00100000:0.0:1783349777.366779:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659410048 00000100:00100000:0.0:1783349777.366786:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659410176 00000100:00100000:0.0:1783349777.366795:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659410176 00000100:00100000:0.0:1783349777.366812:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783349777.366818:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:6510:x1869977659409792:12345-0@lo:104: 00010000:00010000:0.0:1783349777.366828:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.366965:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783349777.366971:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:6510:x1869977659409792:12345-0@lo:104: Request processed in 153us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.366978:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783349777.366992:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783349777.366998:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:6510:x1869977659409920:12345-0@lo:104: 00010000:00010000:0.0:1783349777.367005:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.367059:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659409792:0@lo:104: 00000100:00100000:3.0:1783349777.367068:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659409920:0@lo:104: 00010000:00010000:2.0:1783349777.367331:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349777.367338:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367345:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea38215fe00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349777.367349:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367357:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349777.367375:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349777.367380:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349777.367414:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367420:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349777.367446:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367453:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea38215fe00/0xd05e6ae1590e1e69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367464:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349777.367467:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367472:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349777.367475:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367481:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349777.367487:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349777.367493:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349777.367521:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367526:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349777.367542:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367548:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f800/0xd05e6ae1590e1e4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367557:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349777.367559:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349777.367561:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349777.367568:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349777.367580:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659410432:0@lo:103: 00000100:00100000:2.0:1783349777.367621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349777.367661:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659410432 00000100:00100000:2.0:1783349777.367666:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659410432 00010000:00010000:2.0:1783349777.367687:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e1e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e4d expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349777.367709:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783349777.367717:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea35094e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3647:x1869977659410432:12345-0@lo:103: 00010000:00010000:2.0:1783349777.367728:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349777.367732:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e1e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e4d expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367740:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e1e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e4d expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367759:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd600/0xd05e6ae1590e1e54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1e4d expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.367776:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349777.367804:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea35094e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3647:x1869977659410432:12345-0@lo:103: Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349777.367811:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783349777.367865:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659410432:0@lo:103: 00000100:00100000:2.0:1783349777.367880:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349777.367887:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659410304:0@lo:103: 00000100:00100000:2.0:1783349777.368061:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349777.368234:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1783349777.368242:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:6510:x1869977659409920:12345-0@lo:104: Request processed in 1244us (2461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.368250:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783349777.368268:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783349777.368276:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea242721050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6510:x1869977659410048:12345-0@lo:104: 00010000:00010000:0.0:1783349777.368286:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368368:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783349777.368374:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea242721050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6510:x1869977659410048:12345-0@lo:104: Request processed in 100us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.368380:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783349777.368415:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783349777.368421:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659410176:12345-0@lo:104: 00010000:00010000:0.0:1783349777.368429:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368458:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783349777.368463:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6510:x1869977659410176:12345-0@lo:104: Request processed in 43us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.368468:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1783349777.368483:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783349777.368488:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368495:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349777.368509:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368518:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349777.368524:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349777.368530:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783349777.368552:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368558:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349777.368567:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368583:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea341524600/0xd05e6ae1590e1e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e15 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368594:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349777.368598:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368603:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc400 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349777.368606:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368613:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349777.368619:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349777.368624:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783349777.368636:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368642:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349777.368657:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368664:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e1de4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1deb expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.368675:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349777.368682:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349777.368684:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349777.368722:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349777.368733:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659410560:0@lo:103: 00000100:00100000:2.0:1783349777.368760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349777.368898:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659410048:0@lo:104: 00000100:00100000:1.0:1783349777.368906:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349777.368915:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659410688:0@lo:103: 00000100:00100000:1.0:1783349777.368948:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1869977659410176:0@lo:104: 00010000:00010000:1.0:1783349777.368978:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.369058:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349777.369102:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.369188:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659410304 00000100:00100000:3.0:1783349777.369194:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659410304 00010000:00010000:3.0:1783349777.369217:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e1e70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e69 expref: 18 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.369240:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659410560 00000100:00100000:3.0:1783349777.369243:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659410560 00010000:00010000:3.0:1783349777.369254:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8e000/0xd05e6ae1590e1e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e0e expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.369286:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783349777.369293:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3648:x1869977659410304:12345-0@lo:103: 00010000:00010000:3.0:1783349777.369304:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349777.369309:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e1e70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e69 expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369318:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e1e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e69 expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369332:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e1e70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1e69 expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369343:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349777.369373:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3648:x1869977659410304:12345-0@lo:103: Request processed in 81us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349777.369379:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783349777.369393:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783349777.369399:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:3647:x1869977659410560:12345-0@lo:103: 00010000:00010000:3.0:1783349777.369406:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349777.369410:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8e000/0xd05e6ae1590e1e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e0e expref: 17 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369419:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8e000/0xd05e6ae1590e1e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e0e expref: 17 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369428:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8e000/0xd05e6ae1590e1e15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1e0e expref: 17 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369444:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349777.369467:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3647:x1869977659410560:12345-0@lo:103: Request processed in 69us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349777.369472:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783349777.369610:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659410560:0@lo:103: 00000100:00100000:2.0:1783349777.369634:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659410304:0@lo:103: 00000100:00100000:3.0:1783349777.369743:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659410688 00000100:00100000:3.0:1783349777.369747:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659410688 00010000:00010000:3.0:1783349777.369762:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e1deb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1de4 expref: 16 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.369787:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783349777.369792:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3649:x1869977659410688:12345-0@lo:103: 00010000:00010000:3.0:1783349777.369798:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349777.369802:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e1deb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1de4 expref: 16 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369810:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e1deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1de4 expref: 16 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369820:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e1deb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1de4 expref: 16 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369832:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369839:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369852:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369869:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369876:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369881:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369886:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349777.369889:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369896:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369915:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.369925:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349777.369951:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3649:x1869977659410688:12345-0@lo:103: Request processed in 159us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349777.369957:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783349777.370041:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659410688:0@lo:103: 00010000:00010000:0.0:1783349777.370061:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.370069:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.370075:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e1ef5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783349777.370089:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783349777.372055:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:9509:x1869977659408896:12345-0@lo:253: Request processed in 15291us (15570us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.372070:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783349777.372351:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659408896:0@lo:253: 10000000:01000000:3.0:1783349777.372367:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783349777.372371:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783349777.372373:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783349777.372374:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349777.372375:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1783349777.372376:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349777.372386:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349777.372388:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349777.372390:0:9509:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783349777.372391:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349777.372393:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783349777.372414:0:9509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea36d976000 from lustre-OST0001 10000000:01000000:3.0:1783349777.372446:0:9509:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783349777.372449:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783349777.372457:0:9509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ea349f8b380 local copy 10000000:01000000:3.0:1783349777.372461:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783349777.372497:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.372521:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.372530:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.372549:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659410816:0@lo:101: 00000100:00100000:3.0:1783349777.372587:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.372889:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349777.372929:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659410816 00000100:00100000:0.0:1783349777.372936:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659410816 00000100:00100000:0.0:1783349777.373010:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783349777.373019:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:9509:x1869977659410816:12345-0@lo:101: 00010000:00010000:0.0:1783349777.373031:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349777.373043:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e1f03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1efc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.373067:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e1f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1efc expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.373076:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e1f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1efc expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.373096:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ec00, rc 0) 00000100:00100000:0.0:1783349777.373133:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659410816:12345-0@lo:101: Request processed in 116us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.373168:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783349777.373275:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659410816:0@lo:101: 00010000:00010000:3.0:1783349777.373288:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.373296:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.373381:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659410944:0@lo:501: 00000100:00100000:3.0:1783349777.373406:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.373687:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349777.373718:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659410944 00000100:00100000:2.0:1783349777.373730:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659410944 00000100:00100000:2.0:1783349777.373753:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783349777.373759:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659410944:12345-0@lo:501: 00000100:00100000:2.0:1783349777.373829:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659410944:12345-0@lo:501: Request processed in 69us (421us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783349777.373835:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783349777.373954:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659410944:0@lo:501: 10000000:01000000:3.0:1783349777.373967:0:9509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783349777.373985:0:9509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783349777.373991:0:9509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.373998:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.374006:0:9509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.374031:0:9509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783349777.374056:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea36d976000 10000000:01000000:3.0:1783349777.374060:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783349777.374066:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783349777.374068:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783349777.374072:0:9509:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783349777.374075:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783349777.374091:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.374099:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.374106:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.374117:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411072:0@lo:101: 00000100:00100000:3.0:1783349777.374180:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.374197:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1783349777.374246:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659411072 00000100:00100000:2.0:1783349777.374250:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659411072 00000100:00100000:2.0:1783349777.374269:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783349777.374274:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659411072:12345-0@lo:101: 00010000:00010000:2.0:1783349777.374288:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349777.374298:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e1f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1f0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.374314:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e1f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f0a expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.374321:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e1f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f0a expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.374328:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cca00, rc 0) 00000100:00100000:2.0:1783349777.374548:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659411072:12345-0@lo:101: Request processed in 273us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349777.374555:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:2.0:1783349777.374578:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349777.374583:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.374591:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524a00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349777.374595:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.374603:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349777.374610:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349777.374616:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349777.374634:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.374646:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349777.374669:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.374676:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea341524a00/0xd05e6ae1590e1efc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd05e6ae1590e1f03 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.374686:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349777.374688:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349777.374690:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349777.374697:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349777.374708:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659411200:0@lo:103: 00000100:00100000:2.0:1783349777.374745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349777.374774:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659411200 00000100:00100000:2.0:1783349777.374777:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659411200 00000100:00100000:2.0:1783349777.374807:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349777.374814:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3648:x1869977659411200:12345-0@lo:103: 00010000:00010000:2.0:1783349777.374823:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349777.374835:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e1f03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e1efc expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349777.374844:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349777.374870:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3648:x1869977659411200:12345-0@lo:103: Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349777.374876:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349777.374903:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659411200:0@lo:103: 00000100:00100000:3.0:1783349777.375100:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411072:0@lo:101: 00010000:00010000:3.0:1783349777.375112:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.375119:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.375368:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411328:0@lo:501: 00000100:00100000:3.0:1783349777.375399:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.375462:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d0000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349777.375516:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659411328 00000100:00100000:0.0:1783349777.375521:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659411328 00000100:00100000:0.0:1783349777.375589:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783349777.375598:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659411328:12345-0@lo:501: 00000100:00100000:0.0:1783349777.375703:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659411328:12345-0@lo:501: Request processed in 106us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.375710:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783349777.375776:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411328:0@lo:501: 00000100:00100000:3.0:1783349777.375801:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411456:0@lo:503: 00000100:00100000:3.0:1783349777.375836:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.375951:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1783349777.376009:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659411456 00000100:00100000:2.0:1783349777.376019:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659411456 00000100:00100000:2.0:1783349777.376038:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783349777.376044:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659411456:12345-0@lo:503: 00000100:00100000:2.0:1783349777.376120:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659411456:12345-0@lo:503: Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349777.376127:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783349777.376232:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411456:0@lo:503: 00000040:00080000:3.0:1783349777.376438:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783349777.376529:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411584:0@lo:502: 00000100:00100000:3.0:1783349777.376568:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.376598:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1783349777.376651:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659411584 00000100:00100000:2.0:1783349777.376656:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659411584 00000100:00100000:2.0:1783349777.376677:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783349777.376683:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659411584:12345-0@lo:502: 00000100:00100000:2.0:1783349777.376838:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659411584:12345-0@lo:502: Request processed in 155us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349777.376846:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783349777.376926:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411584:0@lo:502: 00000040:00080000:3.0:1783349777.377130:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783349777.377194:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783349777.377210:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783349777.377225:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783349777.377253:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783349777.377268:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783349777.377288:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411712:0@lo:502: 00000100:00100000:3.0:1783349777.377323:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.377342:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1783349777.377453:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659411712 00000100:00100000:2.0:1783349777.377458:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659411712 00000100:00100000:2.0:1783349777.377478:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783349777.377484:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659411712:12345-0@lo:502: 00000100:00100000:2.0:1783349777.377561:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659411712:12345-0@lo:502: Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349777.377568:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783349777.377639:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411712:0@lo:502: 00000040:00080000:3.0:1783349777.377675:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1783349777.377683:0:9509:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1783349777.379925:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783349777.379939:0:9520:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1783349777.379946:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349777.379948:0:9520:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783349777.379957:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783349777.379973:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ea24244cd40) 00000020:00000080:2.0:1783349777.379998:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783349777.380004:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783349777.380084:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea36d976000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783349777.380093:0:9520:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783349777.380099:0:9520:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd05e6ae1590e1f1f 00010000:00010000:2.0:1783349777.387550:0:9520:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1783349777.388354:0:9520:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1783349777.393034:0:9520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783349777.395232:0:9520:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1783349777.409373:0:9520:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1783349777.409796:0:9520:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1783349777.418239:0:9520:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1783349777.424246:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783349777.424258:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349777.424264:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349777.424266:0:9520:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783349777.424269:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349777.424274:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349777.424275:0:9520:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783349777.424278:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783349777.424280:0:9520:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783349777.424300:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349777.424303:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349777.424304:0:9520:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783349777.424307:0:9520:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783349777.426229:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1783349777.426283:0:9509:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783349777.426319:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.426334:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349777.426355:0:9509:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d976000 from 1 10000000:01000000:1.0:1783349777.426358:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783349777.426535:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.426544:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.426566:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349777.426589:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411840:0@lo:101: 00000100:00100000:1.0:1783349777.426656:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349777.426703:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349777.431213:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659411840 00000100:00100000:3.0:1783349777.431228:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659411840 00000100:00100000:3.0:1783349777.431289:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783349777.431298:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:9509:x1869977659411840:12345-0@lo:101: 00010000:00010000:3.0:1783349777.431315:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349777.431332:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea341524a00/0xd05e6ae1590e1f2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1f26 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.431362:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea341524a00/0xd05e6ae1590e1f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f26 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.431372:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea341524a00/0xd05e6ae1590e1f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f26 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.431381:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341524a00, rc 0) 00000100:00100000:3.0:1783349777.431462:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659411840:12345-0@lo:101: Request processed in 165us (4806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349777.431469:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783349777.433196:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411840:0@lo:101: 00010000:00010000:1.0:1783349777.433223:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.433235:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349777.433348:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411968:0@lo:501: 00000100:00100000:1.0:1783349777.433400:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349777.433434:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349777.433597:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659411968 00000100:00100000:0.0:1783349777.433605:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659411968 00000100:00100000:0.0:1783349777.433663:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783349777.433673:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659411968:12345-0@lo:501: 00000100:00100000:0.0:1783349777.433781:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659411968:12345-0@lo:501: Request processed in 110us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.433789:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783349777.434089:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659411968:0@lo:501: 00000100:00100000:1.0:1783349777.435266:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412096:0@lo:503: 00000100:00100000:1.0:1783349777.435360:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349777.435401:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349777.435559:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659412096 00000100:00100000:0.0:1783349777.435567:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659412096 00000100:00100000:0.0:1783349777.435614:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783349777.435623:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659412096:12345-0@lo:503: 00000100:00100000:0.0:1783349777.435736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659412096:12345-0@lo:503: Request processed in 114us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.435744:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783349777.435889:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412096:0@lo:503: 00000040:00080000:3.0:1783349777.437927:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783349777.438044:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412224:0@lo:502: 00000100:00100000:3.0:1783349777.438123:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.438188:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a480 going to sleep for 11 seconds 00000100:00100000:0.0:1783349777.441552:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659412224 00000100:00100000:0.0:1783349777.441568:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659412224 00000100:00100000:0.0:1783349777.441638:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783349777.441649:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659412224:12345-0@lo:502: 00000100:00100000:0.0:1783349777.441841:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659412224:12345-0@lo:502: Request processed in 193us (3717us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.441849:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783349777.441940:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412224:0@lo:502: 00000040:00080000:3.0:1783349777.444344:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783349777.444401:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783349777.444449:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412352:0@lo:502: 00000100:00100000:3.0:1783349777.444545:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.444588:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b662e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349777.445703:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659412352 00000100:00100000:0.0:1783349777.445715:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659412352 00000100:00100000:0.0:1783349777.445783:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783349777.445793:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659412352:12345-0@lo:502: 00000100:00100000:0.0:1783349777.445946:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659412352:12345-0@lo:502: Request processed in 154us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.445954:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783349777.446054:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412352:0@lo:502: 00000040:00080000:3.0:1783349777.446119:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1783349777.446132:0:9509:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783349777.447763:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349777.447774:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349777.447776:0:9524:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783349777.447799:0:9524:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea36d976000 00000020:00000080:0.0:1783349777.447802:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783349777.447814:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349777.447817:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349777.447818:0:9524:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783349777.447821:0:9524:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783349777.448078:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783349777.448110:0:9509:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783349777.448232:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.448245:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349777.448298:0:9509:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783349777.448302:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea36d976000 10000000:01000000:3.0:1783349777.448304:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea36d976000 10000000:01000000:3.0:1783349777.448308:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783349777.448314:0:9509:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea36d976000 from 1 10000000:01000000:3.0:1783349777.448316:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783349777.448362:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.448371:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.448381:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.448403:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412480:0@lo:101: 00000100:00100000:3.0:1783349777.448467:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.448517:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b662300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349777.448530:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659412480 00000100:00100000:0.0:1783349777.448539:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659412480 00000100:00100000:0.0:1783349777.448592:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783349777.448601:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9509:x1869977659412480:12345-0@lo:101: 00010000:00010000:0.0:1783349777.448614:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349777.448626:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e1f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1f34 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.448655:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e1f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f34 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.448665:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e1f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f34 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.448674:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f400, rc 0) 00000100:00100000:0.0:1783349777.448720:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659412480:12345-0@lo:101: Request processed in 120us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.448726:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783349777.448968:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412480:0@lo:101: 00010000:00010000:3.0:1783349777.449257:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.449267:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.449376:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412608:0@lo:501: 00000100:00100000:3.0:1783349777.449411:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.449445:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b662300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349777.450242:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659412608 00000100:00100000:0.0:1783349777.450251:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659412608 00000100:00100000:0.0:1783349777.450295:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783349777.450304:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659412608:12345-0@lo:501: 00000100:00100000:0.0:1783349777.450443:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659412608:12345-0@lo:501: Request processed in 139us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.450450:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783349777.450548:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412608:0@lo:501: 00000100:00100000:1.0:1783349777.450593:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412736:0@lo:503: 00000100:00100000:1.0:1783349777.450646:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.450679:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659412736 00000100:00100000:1.0:1783349777.450684:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349777.450685:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659412736 00000100:00100000:3.0:1783349777.450727:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783349777.450733:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659412736:12345-0@lo:503: 00000100:00100000:3.0:1783349777.451492:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659412736:12345-0@lo:503: Request processed in 754us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349777.451510:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783349777.452246:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412736:0@lo:503: 00000040:00080000:0.0:1783349777.452573:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783349777.452649:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412864:0@lo:502: 00000100:00100000:0.0:1783349777.452731:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349777.453204:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659412864 00000100:00100000:0.0:1783349777.453206:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cec8300 going to sleep for 11 seconds 00000100:00100000:1.0:1783349777.453214:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659412864 00000100:00100000:1.0:1783349777.453268:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783349777.453285:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659412864:12345-0@lo:502: 00000100:00100000:1.0:1783349777.453408:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659412864:12345-0@lo:502: Request processed in 130us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.453415:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783349777.455745:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412864:0@lo:502: 00000040:00080000:0.0:1783349777.456217:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783349777.456252:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783349777.456267:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783349777.456293:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783349777.456309:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783349777.456323:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783349777.456336:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783349777.456351:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783349777.456364:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783349777.456379:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783349777.456393:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783349777.456407:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783349777.456423:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783349777.456439:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783349777.456453:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783349777.456466:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783349777.456481:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783349777.456495:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783349777.456526:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783349777.456543:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783349777.456558:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783349777.456572:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783349777.456604:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783349777.456622:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783349777.456638:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1783349777.456653:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1783349777.456682:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1783349777.456697:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1783349777.456712:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1783349777.456740:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1783349777.456756:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1783349777.459206:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1783349777.459255:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1783349777.459272:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1783349777.459287:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1783349777.459302:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1783349777.459335:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1783349777.459349:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1783349777.459383:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1783349777.459398:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1783349777.459412:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1783349777.459426:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1783349777.459440:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1783349777.459455:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1783349777.459471:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1783349777.459486:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1783349777.459546:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412992:0@lo:502: 00000100:00100000:0.0:1783349777.459631:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.461444:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659412992 00000100:00100000:3.0:1783349777.461456:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659412992 00000100:00100000:3.0:1783349777.461531:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783349777.461541:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659412992:12345-0@lo:502: 00000100:00100000:3.0:1783349777.462840:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659412992:12345-0@lo:502: Request processed in 1294us (3203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349777.462852:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783349777.463958:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cec8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349777.464059:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659412992:0@lo:502: 00000040:00080000:0.0:1783349777.464225:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1783349777.464239:0:9509:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1783349777.469460:0:9525:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783349777.469506:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ea243518000) 00000020:00000080:2.0:1783349777.469532:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1783349777.469708:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea36d976000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783349777.469713:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea36d976000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783349777.469715:0:9525:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea36d976000 3 00010000:00080000:2.0:1783349777.469754:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea243524000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1783349777.476667:0:9525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1783349777.476795:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783349777.476844:0:9525:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783349777.476876:0:9525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd05e6ae1590e1f49 00000100:00080000:2.0:1783349777.476889:0:9525:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783349777.476910:0:9525:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ea243524000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783349777.476951:0:9525:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36cf4c700 x1869977659413120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783349777.476988:0:9525:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1783349777.477236:0:9525:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:3.0:1783349777.477245:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659413120:0@lo:38: 00000020:00000080:2.0:1783349777.477250:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ea24351cd40) 00000020:00000080:2.0:1783349777.477262:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:3.0:1783349777.477329:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1783349777.477390:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea36d976000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783349777.477395:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea36d976000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783349777.477397:0:9525:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea36d976000 3 00010000:00080000:2.0:1783349777.477424:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea243520000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.150@tcp at head 00000100:00100000:2.0:1783349777.477496:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659413248:0@lo:400: 00000100:00100000:1.0:1783349777.477645:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659413120 00000100:00100000:1.0:1783349777.477652:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659413120 00000100:00100000:1.0:1783349777.477699:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783349777.477705:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869977659413120:12345-0@lo:38: 00010000:00080000:1.0:1783349777.477728:0:6517:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1783349777.477766:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd05e6ae1590e1f57 00000004:00100000:1.0:1783349777.477784:0:6517:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783349777.477816:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8ea375e04000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349777.477876:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869977659413120:12345-0@lo:38: Request processed in 170us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.477883:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783349777.477925:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cf4c700 x1869977659413120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349777.477949:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783349777.477957:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1783349777.477964:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783349777.477968:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783349777.477970:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243524000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783349777.477976:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659413120:0@lo:38: 00000100:00100000:0.0:1783349777.483007:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659413632:0@lo:400: 00000100:00100000:0.0:1783349777.483088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349777.483428:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659414144:0@lo:400: 00000100:00100000:0.0:1783349777.483454:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349777.483492:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783349777.483508:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659413504:0@lo:400: 00000100:00100000:0.0:1783349777.483536:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349777.483554:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659414016:0@lo:400: 00000100:00100000:0.0:1783349777.483574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349777.483637:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659414144 00000100:00100000:0.0:1783349777.483645:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659414144 00000100:00100000:0.0:1783349777.483693:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659414016 00000100:00100000:0.0:1783349777.483710:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659414016 00000100:00100000:0.0:1783349777.483728:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349777.483737:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659414144:12345-0@lo:400: 00000100:00100000:0.0:1783349777.483792:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659414144:12345-0@lo:400: Request processed in 56us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.483800:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349777.483817:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783349777.483823:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659414016:12345-0@lo:400: 00000100:00100000:0.0:1783349777.483849:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659414016:12345-0@lo:400: Request processed in 27us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.483856:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783349777.483871:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659413504 00000100:00100000:0.0:1783349777.483875:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659413504 00000100:00100000:0.0:1783349777.483900:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783349777.483905:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659413504:12345-0@lo:400: 00000100:00100000:0.0:1783349777.483938:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659413504:12345-0@lo:400: Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.483944:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1783349777.483979:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48df80 x1869977659413504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349777.483994:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659413504:0@lo:400: 00010000:00080000:0.0:1783349777.484005:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48d500 x1869977659414016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349777.484013:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659414016:0@lo:400: 00010000:00080000:0.0:1783349777.484023:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da5c00 x1869977659414144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349777.484045:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659414144:0@lo:400: 00000100:00100000:3.0:1783349777.484795:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659413632 00000100:00100000:3.0:1783349777.484802:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659413632 00000100:00100000:3.0:1783349777.484836:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783349777.484844:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659413632:12345-0@lo:400: 00000100:00100000:3.0:1783349777.484905:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659413632:12345-0@lo:400: Request processed in 62us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349777.484911:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783349777.484916:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659413632:0@lo:400: 00000100:00100000:3.0:1783349777.485202:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659413376:0@lo:400: 00000100:00100000:3.0:1783349777.485238:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.485258:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659413888:0@lo:400: 00000100:00100000:3.0:1783349777.485278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.485376:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349777.485383:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659413760:0@lo:400: 00000100:00100000:3.0:1783349777.485404:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.485426:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659413376 00000100:00100000:3.0:1783349777.485429:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659413376 00000100:00100000:2.0:1783349777.485442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.485452:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783349777.485458:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659413376:12345-0@lo:400: 00000100:00100000:2.0:1783349777.485462:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659413888 00000100:00100000:2.0:1783349777.485465:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659413888 00000100:00100000:2.0:1783349777.485488:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659413760 00000100:00100000:2.0:1783349777.485491:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659413760 00000100:00100000:2.0:1783349777.485514:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659413248 00000100:00100000:2.0:1783349777.485517:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659413248 00000100:00100000:2.0:1783349777.485528:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349777.485534:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659413888:12345-0@lo:400: 00000100:00100000:2.0:1783349777.485568:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659413888:12345-0@lo:400: Request processed in 34us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349777.485573:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659413376:12345-0@lo:400: Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349777.485575:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783349777.485579:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783349777.485588:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349777.485594:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659413760:12345-0@lo:400: 00000100:00100000:3.0:1783349777.485597:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783349777.485602:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659413248:12345-0@lo:400: 00000100:00100000:2.0:1783349777.485618:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659413760:12345-0@lo:400: Request processed in 25us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349777.485633:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1783349777.485662:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48ed80 x1869977659413760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349777.485674:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659413760:0@lo:400: 00000100:00100000:2.0:1783349777.485684:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659413376:0@lo:400: 00010000:00080000:2.0:1783349777.485692:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48f480 x1869977659413888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349777.485697:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659413248:12345-0@lo:400: Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349777.485700:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659413888:0@lo:400: 00000100:00100000:3.0:1783349777.485704:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1783349777.486222:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea37f48ca80 x1869977659413248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349777.486232:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659413248:0@lo:400: 00000100:00100000:3.0:1783349777.487758:0:9526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9526:1869977659414272:0@lo:901: 00000100:00100000:3.0:1783349777.487818:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349777.487856:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659414272 00000100:00100000:3.0:1783349777.487862:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659414272 00000100:00080000:2.0:1783349777.488069:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349777.488455:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783349777.488465:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1869977659414272:12345-0@lo:901: 00000100:00100000:3.0:1783349777.488779:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1869977659414272:12345-0@lo:901: Request processed in 315us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349777.488786:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783349777.488822:0:9526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b662c00 going to sleep for 11 seconds 00010000:00080000:3.0:1783349777.488844:0:9526:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea243722300 x1869977659414272/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783349793 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349777.488858:0:9526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9526:1869977659414272:0@lo:901: 00010000:00010000:0.0:1783349777.489959:0:9525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1783349777.490063:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1783349777.490116:0:9525:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783349777.490128:0:9525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd05e6ae1590e1f5e 00000100:00080000:0.0:1783349777.490153:0:9525:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783349777.490159:0:9525:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ea243520000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349777.490191:0:9525:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36dbbb480 x1869977659414400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783349777.490219:0:9525:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783349777.490535:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869977659414400:0@lo:38: 00000100:00100000:2.0:1783349777.490599:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349777.491183:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659414400 00000100:00100000:0.0:1783349777.491191:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659414400 00000100:00100000:0.0:1783349777.491230:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349777.491237:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869977659414400:12345-0@lo:38: 00010000:00080000:0.0:1783349777.491263:0:8582:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1783349777.491565:0:8582:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd05e6ae1590e1f65 00000004:00100000:0.0:1783349777.491585:0:8582:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783349777.491743:0:8582:0:(import.c:65:import_set_state_nolock()) ffff8ea37f495800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349777.491820:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869977659414400:12345-0@lo:38: Request processed in 581us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.491828:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783349777.491850:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36dbbb480 x1869977659414400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349777.491861:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783349777.491868:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1783349777.491875:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783349777.491880:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783349777.491883:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243520000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783349777.491889:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869977659414400:0@lo:38: 00000040:00080000:1.0:1783349777.492032:0:9525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1783349777.492367:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1783349777.492394:0:9509:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783349777.492443:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.492461:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783349777.492513:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783349777.492515:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783349777.492517:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349777.492518:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349777.492519:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349777.492521:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349777.492522:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783349777.492523:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349777.492525:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349777.492527:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349777.492528:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783349777.492531:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1783349777.492534:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783349777.492535:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783349777.492536:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349777.492537:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349777.492538:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349777.492539:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349777.492540:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783349777.492542:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349777.492543:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349777.492544:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349777.492545:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783349777.492573:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783349777.492587:0:9509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659414528:0@lo:253: 00000100:00100000:0.0:1783349777.492631:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349777.492661:0:9509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cec8600 going to sleep for 11 seconds 00000100:00100000:2.0:1783349777.492777:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659414528 00000100:00100000:2.0:1783349777.492787:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659414528 00000100:00100000:2.0:1783349777.492821:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783349777.492827:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659414528:12345-0@lo:253: 20000000:01000000:2.0:1783349777.492849:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783349777.492861:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783349777.497874:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783349777.497893:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783349777.498355:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9509:x1869977659414528:12345-0@lo:253: Request processed in 5523us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349777.498367:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783349777.498492:0:9509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9509:1869977659414528:0@lo:253: 10000000:01000000:0.0:1783349777.498518:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783349777.498522:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783349777.498523:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783349777.498534:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349777.498536:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349777.498537:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349777.498538:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349777.498540:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783349777.498541:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349777.498542:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349777.498544:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349777.498545:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783349777.498558:0:9509:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1783349777.498888:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783349777.498895:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783349777.498917:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.498934:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e1e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e5b expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.498942:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cce00/0xd05e6ae1590e1ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1ea1 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.498951:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.498997:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cce00/0xd05e6ae1590e1ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1ea1 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499012:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea3582cce00/0xd05e6ae1590e1ea8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ea1 expref: 16 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349777.499026:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659414656:0@lo:104: 00000100:00100000:1.0:1783349777.499077:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783349777.499129:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e1e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1e5b expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499157:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e1e62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e5b expref: 16 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349777.499167:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659414784:0@lo:104: 00000100:00100000:1.0:1783349777.499190:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349777.499213:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77000 going to sleep for 11 seconds 00000100:00100000:1.0:1783349777.499232:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659414656 00000100:00100000:1.0:1783349777.499238:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659414656 00000100:00100000:1.0:1783349777.499272:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659414784 00000100:00100000:1.0:1783349777.499275:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659414784 00000100:00100000:1.0:1783349777.499290:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349777.499299:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6533:x1869977659414656:12345-0@lo:104: 00010000:00010000:1.0:1783349777.499311:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499370:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783349777.499376:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:6533:x1869977659414656:12345-0@lo:104: Request processed in 79us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.499383:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349777.499397:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349777.499403:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6533:x1869977659414784:12345-0@lo:104: 00010000:00010000:1.0:1783349777.499411:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499443:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783349777.499455:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:6533:x1869977659414784:12345-0@lo:104: Request processed in 52us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.499461:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1783349777.499479:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349777.499484:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499491:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349777.499494:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499515:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349777.499523:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349777.499529:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349777.499569:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499576:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349777.499591:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499597:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e1ea1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1ea8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499611:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349777.499614:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499632:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea38215f800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349777.499635:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499642:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349777.499648:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349777.499654:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349777.499668:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499686:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349777.499692:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499697:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea38215f800/0xd05e6ae1590e1e5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.499710:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349777.499711:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349777.499713:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349777.499720:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349777.499746:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659414656:0@lo:104: 00000100:00100000:1.0:1783349777.499754:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1869977659414784:0@lo:104: 00010000:00010000:1.0:1783349777.499768:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349777.501345:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659415040:0@lo:103: 00000100:00100000:2.0:1783349777.501611:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349777.501683:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349777.501692:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659414912:0@lo:103: 00000100:00100000:2.0:1783349777.501714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349777.501786:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659415040 00000100:00100000:1.0:1783349777.501794:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659415040 00010000:00010000:1.0:1783349777.501829:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e1e62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e5b expref: 17 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349777.501859:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659414912 00000100:00100000:1.0:1783349777.501862:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659414912 00010000:00010000:1.0:1783349777.501874:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cce00/0xd05e6ae1590e1ea8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ea1 expref: 18 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349777.501886:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783349777.501899:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3647:x1869977659415040:12345-0@lo:103: 00010000:00010000:3.0:1783349777.501914:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349777.501920:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e1e62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e5b expref: 18 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.501944:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e1e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e5b expref: 18 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.501960:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e1e62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1e5b expref: 18 pid: 6512 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349777.501975:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349777.502022:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:3647:x1869977659415040:12345-0@lo:103: Request processed in 126us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349777.502075:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349777.502083:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:3647:x1869977659414912:12345-0@lo:103: 00010000:00010000:1.0:1783349777.502091:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349777.502095:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cce00/0xd05e6ae1590e1ea8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ea1 expref: 17 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502103:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cce00/0xd05e6ae1590e1ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ea1 expref: 17 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502125:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cce00/0xd05e6ae1590e1ea8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1ea1 expref: 17 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502320:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502329:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783349777.502346:0:7459:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008190708s 00000100:00100000:2.0:1783349777.502587:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659415040:0@lo:103: 00000100:00100000:3.0:1783349777.502672:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1783349777.502828:0:7459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502848:0:7459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502858:0:7459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502864:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502870:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783349777.502873:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502882:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502904:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349777.502916:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349777.502946:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349777.502957:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349777.502965:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3647:x1869977659414912:12345-0@lo:103: Request processed in 882us (1248us total) trans 0 rc 0/0 00010000:00010000:0.0:1783349777.502967:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e1f6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349777.502979:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783349777.503073:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659414912:0@lo:103: 00080000:10000000:1.0:1783349777.503923:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1783349777.504089:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1783349777.505342:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1783349777.506237:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1783349777.506878:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1783349777.507111:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1783349777.508496:0:9509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1783349777.518441:0:9509:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783349777.518453:0:9509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783349777.518494:0:9509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783349777.518554:0:9509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783349777.518585:0:9509:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1783349777.518607:0:9509:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1783349777.519566:0:9509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783349777.520904:0:9509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1783349778.053268:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783349778.285540:0:9581:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783349778.285760:0:9581:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783349778.826742:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349778.826771:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659415168:0@lo:41: 00000100:00100000:0.0:1783349778.826849:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349778.826962:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659415168 00000100:00100000:1.0:1783349778.826971:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659415168 00000100:00100000:1.0:1783349778.827025:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783349778.827035:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659415168:12345-0@lo:41: 00000004:00000024:1.0:1783349778.827069:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1783349778.827117:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659415168:12345-0@lo:41: Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349778.827123:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783349778.827191:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659415168:0@lo:41: 00010000:00010000:1.0:1783349779.076971:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349780.100377:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349780.356464:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349780.356500:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659415296:0@lo:41: 00000100:00100000:3.0:1783349780.356573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349780.356820:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659415296 00000100:00100000:1.0:1783349780.356829:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659415296 00000100:00100000:1.0:1783349780.356880:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783349780.356890:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659415296:12345-0@lo:41: 00000004:00000024:1.0:1783349780.356921:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783349780.356972:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659415296:12345-0@lo:41: Request processed in 84us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349780.356980:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783349780.357024:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659415296:0@lo:41: 00010000:00010000:2.0:1783349781.124442:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349781.892440:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659415424:0@lo:13: 00000100:00100000:2.0:1783349781.892519:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349781.892573:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349781.892579:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659415552:0@lo:13: 00000100:00100000:2.0:1783349781.892601:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349781.892630:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659415424 00000100:00100000:2.0:1783349781.892646:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659415424 00000100:00100000:2.0:1783349781.892683:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659415552 00000100:00100000:2.0:1783349781.892685:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659415552 00000100:00100000:2.0:1783349781.892701:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783349781.892708:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659415424:12345-0@lo:13: 00002000:00000024:2.0:1783349781.892733:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349781.892767:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659415424:12345-0@lo:13: Request processed in 60us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349781.892774:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783349781.892787:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783349781.892793:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659415552:12345-0@lo:13: 00002000:00000024:2.0:1783349781.892801:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349781.892818:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659415552:12345-0@lo:13: Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349781.892823:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1783349781.892837:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783349781.892862:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cf4d500 x1869977659415552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349781.892879:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659415552:0@lo:13: 00010000:00080000:2.0:1783349781.892899:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243720e00 x1869977659415424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349781.892911:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659415424:0@lo:13: 00010000:00010000:1.0:1783349782.149295:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349782.926764:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659415680:0@lo:400: 00000100:00100000:3.0:1783349782.926833:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349782.927955:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659415680 00000100:00100000:2.0:1783349782.927966:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659415680 00000100:00100000:2.0:1783349782.928017:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783349782.928026:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3648:x1869977659415680:12345-0@lo:400: 00000100:00100000:2.0:1783349782.930974:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3648:x1869977659415680:12345-0@lo:400: Request processed in 2939us (4130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349782.930989:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783349782.931215:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659415680:0@lo:400: 00000100:00100000:3.0:1783349782.931233:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349782.931416:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659415936:0@lo:400: 00000100:00100000:3.0:1783349782.931478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349782.931520:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659415936 00000100:00100000:3.0:1783349782.931527:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659415936 00000100:00100000:3.0:1783349782.931566:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783349782.931573:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659415936:12345-0@lo:400: 00000100:00100000:3.0:1783349782.931618:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659415936:12345-0@lo:400: Request processed in 45us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349782.931623:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783349782.931664:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659415936:0@lo:400: 00000100:00100000:2.0:1783349782.931781:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659415808:0@lo:400: 00000100:00100000:2.0:1783349782.931811:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349782.932002:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659416064:0@lo:400: 00000100:00100000:2.0:1783349782.932026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349782.932042:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349782.932051:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659416192:0@lo:400: 00000100:00100000:0.0:1783349782.932076:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349782.932117:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659416320:0@lo:400: 00000100:00100000:2.0:1783349782.934088:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659416576:0@lo:400: 00000100:00100000:2.0:1783349782.934160:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349782.934179:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783349782.934186:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659416448:0@lo:400: 00000100:00100000:2.0:1783349782.934210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349782.934240:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659415808 00000100:00100000:3.0:1783349782.934247:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659415808 00000100:00100000:3.0:1783349782.934281:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659416192 00000100:00100000:3.0:1783349782.934284:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659416192 00000100:00100000:3.0:1783349782.934319:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783349782.934327:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659416192:12345-0@lo:400: 00000100:00100000:3.0:1783349782.934378:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659416192:12345-0@lo:400: Request processed in 52us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349782.934385:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783349782.934513:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659416704:0@lo:400: 00000100:00100000:3.0:1783349782.934541:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349782.934565:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349782.934571:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659416832:0@lo:400: 00000100:00100000:3.0:1783349782.934599:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659416576 00000100:00100000:3.0:1783349782.934603:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659416576 00000100:00100000:3.0:1783349782.934628:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659416704 00000100:00100000:3.0:1783349782.934630:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659416704 00000100:00100000:3.0:1783349782.934641:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349782.934646:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659416576:12345-0@lo:400: 00000100:00100000:3.0:1783349782.934861:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659416576:12345-0@lo:400: Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349782.934868:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349782.934880:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349782.934886:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659416704:12345-0@lo:400: 00000100:00100000:3.0:1783349782.935000:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659416704:12345-0@lo:400: Request processed in 114us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349782.935014:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783349782.935105:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659416064 00000100:00100000:0.0:1783349782.935109:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659416064 00000100:00100000:0.0:1783349782.935155:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783349782.935162:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659416064:12345-0@lo:400: 00000100:00100000:0.0:1783349782.935192:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659416064:12345-0@lo:400: Request processed in 32us (3166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349782.935197:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783349782.935544:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659416448 00000100:00100000:0.0:1783349782.935549:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659416448 00000100:00100000:0.0:1783349782.935582:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783349782.935588:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659416448:12345-0@lo:400: 00000100:00100000:3.0:1783349782.935622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783349782.935657:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48dc00 x1869977659416704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349782.935671:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659416704:0@lo:400: 00000100:00100000:3.0:1783349782.935763:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349782.935787:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659416192:0@lo:400: 00000100:00100000:3.0:1783349782.935806:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659416832 00000100:00100000:3.0:1783349782.935810:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659416832 00000100:00100000:3.0:1783349782.935827:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659416320 00000100:00100000:3.0:1783349782.935829:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659416320 00000100:00100000:3.0:1783349782.935841:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783349782.935847:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659416832:12345-0@lo:400: 00000100:00100000:3.0:1783349782.935882:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659416832:12345-0@lo:400: Request processed in 35us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349782.935887:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783349782.935898:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783349782.935903:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659416320:12345-0@lo:400: 00000100:00100000:3.0:1783349782.936001:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659416320:12345-0@lo:400: Request processed in 26us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349782.936008:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1783349782.936033:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48f480 x1869977659416320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349782.936043:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659416320:0@lo:400: 00010000:00080000:3.0:1783349782.936061:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48d500 x1869977659416832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349782.936079:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659416832:0@lo:400: 00000100:00100000:2.0:1783349782.936132:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659416960:0@lo:400: 00000100:00100000:2.0:1783349782.936184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783349782.936204:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48ed80 x1869977659416576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349782.936213:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659416576:0@lo:400: 00010000:00080000:2.0:1783349782.936223:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36dbbb480 x1869977659416064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349782.936231:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659416064:0@lo:400: 00000100:00100000:2.0:1783349782.936269:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659416960 00000100:00100000:2.0:1783349782.936272:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659416960 00000100:00100000:2.0:1783349782.936285:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783349782.936291:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659415808:12345-0@lo:400: 00000100:00100000:2.0:1783349782.936331:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659415808:12345-0@lo:400: Request processed in 40us (4519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349782.936338:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783349782.936351:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783349782.936356:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659416960:12345-0@lo:400: 00000100:00100000:2.0:1783349782.936386:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659416960:12345-0@lo:400: Request processed in 30us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349782.936392:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1783349782.936493:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36dbbbb80 x1869977659415808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349782.936503:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659415808:0@lo:400: 00000100:00100000:0.0:1783349782.936588:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659416448:12345-0@lo:400: Request processed in 999us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349782.936595:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1783349782.936652:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349782.936655:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1783349782.936672:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48f100 x1869977659416448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349782.936754:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659416448:0@lo:400: 00010000:00080000:2.0:1783349782.936765:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48df80 x1869977659416960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349782.936772:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659416960:0@lo:400: 00010000:00010000:2.0:1783349783.173306:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783349783.262350:0:9871:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783349783.940501:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659417088:0@lo:41: 00000100:00100000:3.0:1783349783.940572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349783.940649:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659417088 00000100:00100000:3.0:1783349783.940657:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659417088 00000100:00100000:3.0:1783349783.940696:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783349783.940704:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659417088:12345-0@lo:41: 00000004:00000024:3.0:1783349783.940744:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1783349783.940791:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659417088:12345-0@lo:41: Request processed in 86us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349783.940808:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783349783.940853:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659417088:0@lo:41: 00000020:00000004:3.0:1783349784.137030:0:9923:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783349784.137997:0:9923:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783349784.198940:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349785.220391:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349785.476417:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659417216:0@lo:41: 00000100:00100000:3.0:1783349785.476498:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349785.476623:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659417216 00000100:00100000:1.0:1783349785.476630:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659417216 00000100:00100000:1.0:1783349785.476683:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783349785.476693:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659417216:12345-0@lo:41: 00000004:00000024:1.0:1783349785.476728:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783349785.476790:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659417216:12345-0@lo:41: Request processed in 98us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.476797:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783349785.476840:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659417216:0@lo:41: 10000000:01000000:2.0:1783349785.477024:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783349785.477030:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea36d918000 from 39 10000000:01000000:2.0:1783349785.477034:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783349785.477061:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.477073:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.477088:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349785.477102:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659417344:0@lo:101: 00000100:00100000:2.0:1783349785.477129:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.477174:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cec8300 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.477218:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659417344 00000100:00100000:1.0:1783349785.477221:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659417344 00000100:00100000:1.0:1783349785.477251:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783349785.477257:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659417344:12345-0@lo:101: 00010000:00010000:1.0:1783349785.477265:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349785.477276:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e1f7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1f73 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.477294:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e1f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f73 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.477303:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e1f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f73 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.477312:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8ca00, rc 0) 00000100:00100000:1.0:1783349785.477341:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659417344:12345-0@lo:101: Request processed in 85us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.477346:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783349785.477404:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659417344:0@lo:101: 00010000:00010000:3.0:1783349785.477416:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.477424:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349785.477496:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243721c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659417472:0@lo:501: 00000100:00100000:3.0:1783349785.477525:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.477544:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc1f840 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.477623:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659417472 00000100:00100000:1.0:1783349785.477627:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659417472 00000100:00100000:1.0:1783349785.477653:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783349785.477659:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659417472:12345-0@lo:501: 00000100:00100000:1.0:1783349785.477761:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659417472:12345-0@lo:501: Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.477777:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783349785.477845:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243721c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659417472:0@lo:501: 00000100:00100000:3.0:1783349785.477872:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243721c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659417600:0@lo:503: 00000100:00100000:3.0:1783349785.477915:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.477932:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc1f840 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.478016:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659417600 00000100:00100000:1.0:1783349785.478019:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659417600 00000100:00100000:1.0:1783349785.478045:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783349785.478050:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659417600:12345-0@lo:503: 00000100:00100000:1.0:1783349785.478132:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659417600:12345-0@lo:503: Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.478155:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783349785.478221:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243721c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659417600:0@lo:503: 00000100:00100000:2.0:1783349785.478591:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9975:1869977659417728:0@lo:502: 00000100:00100000:2.0:1783349785.478620:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.478643:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cec8300 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.478687:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659417728 00000100:00100000:1.0:1783349785.478690:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659417728 00000100:00100000:1.0:1783349785.478716:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783349785.478722:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9975:x1869977659417728:12345-0@lo:502: 00000100:00100000:1.0:1783349785.478795:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9975:x1869977659417728:12345-0@lo:502: Request processed in 72us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.478800:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783349785.478905:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9975:1869977659417728:0@lo:502: 00000100:00100000:2.0:1783349785.478943:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9975:1869977659417856:0@lo:502: 00000100:00100000:2.0:1783349785.478972:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.478991:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3461e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349785.479037:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659417856 00000100:00100000:0.0:1783349785.479041:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659417856 00000100:00100000:0.0:1783349785.479067:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783349785.479073:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9975:x1869977659417856:12345-0@lo:502: 00000100:00100000:0.0:1783349785.479158:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:9975:x1869977659417856:12345-0@lo:502: Request processed in 85us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.479165:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783349785.479231:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9975:1869977659417856:0@lo:502: 00000040:00080000:2.0:1783349785.479247:0:9975:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1783349785.479364:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1783349785.479383:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783349785.479390:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.479410:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349785.479419:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783349785.479421:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1783349785.479423:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783349785.479455:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.479463:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.479471:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349785.479482:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659417984:0@lo:101: 00000100:00100000:0.0:1783349785.479504:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.479528:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242784480 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.479625:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659417984 00000100:00100000:3.0:1783349785.479629:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659417984 00000100:00100000:3.0:1783349785.479656:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783349785.479662:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659417984:12345-0@lo:101: 00010000:00010000:3.0:1783349785.479671:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349785.479682:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1f81 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.479700:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f81 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.479710:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f81 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.479717:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341524c00, rc 0) 00000100:00100000:3.0:1783349785.479756:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659417984:12345-0@lo:101: Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.479761:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783349785.479823:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659417984:0@lo:101: 00010000:00010000:2.0:1783349785.479834:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.479843:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349785.479887:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659418112:0@lo:501: 00000100:00100000:2.0:1783349785.479911:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.479937:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3461e8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.479978:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659418112 00000100:00100000:3.0:1783349785.479987:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659418112 00000100:00100000:3.0:1783349785.480003:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783349785.480008:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659418112:12345-0@lo:501: 00000100:00100000:3.0:1783349785.480097:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659418112:12345-0@lo:501: Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.480104:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783349785.480186:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659418112:0@lo:501: 00000100:00100000:2.0:1783349785.480207:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659418240:0@lo:503: 00000100:00100000:2.0:1783349785.480235:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.480249:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3461e8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.480296:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659418240 00000100:00100000:3.0:1783349785.480300:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659418240 00000100:00100000:3.0:1783349785.480313:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783349785.480318:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659418240:12345-0@lo:503: 00000100:00100000:3.0:1783349785.480380:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659418240:12345-0@lo:503: Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.480386:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783349785.480455:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659418240:0@lo:503: 00000100:00100000:2.0:1783349785.480866:0:9976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9976:1869977659418368:0@lo:502: 00000100:00100000:2.0:1783349785.480910:0:9976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.480929:0:9976:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3461e89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.480971:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659418368 00000100:00100000:3.0:1783349785.480975:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659418368 00000100:00100000:3.0:1783349785.481003:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783349785.481009:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9976:x1869977659418368:12345-0@lo:502: 00000100:00100000:3.0:1783349785.481084:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9976:x1869977659418368:12345-0@lo:502: Request processed in 74us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.481090:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783349785.481216:0:9976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9976:1869977659418368:0@lo:502: 00000020:01000000:2.0:1783349785.481238:0:9976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349785.481246:0:9976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349785.481248:0:9976:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783349785.481252:0:9976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783349785.481254:0:9976:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783349785.481266:0:9976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9976:1869977659418496:0@lo:502: 00000100:00100000:2.0:1783349785.481291:0:9976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.481313:0:9976:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cec8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349785.481348:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659418496 00000100:00100000:0.0:1783349785.481351:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659418496 00000100:00100000:0.0:1783349785.481376:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783349785.481382:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9976:x1869977659418496:12345-0@lo:502: 00000100:00100000:0.0:1783349785.481452:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:9976:x1869977659418496:12345-0@lo:502: Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.481458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783349785.481592:0:9976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9976:1869977659418496:0@lo:502: 00000020:01000000:2.0:1783349785.481608:0:9976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349785.481611:0:9976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349785.481613:0:9976:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783349785.481615:0:9976:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1783349785.481916:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1783349785.481936:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783349785.481945:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.481961:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349785.481971:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783349785.481973:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea357ed9800 from 39 10000000:01000000:0.0:1783349785.481976:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783349785.482002:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.482012:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.482020:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349785.482032:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659418624:0@lo:101: 00000100:00100000:0.0:1783349785.482057:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.482073:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242784a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.482121:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659418624 00000100:00100000:1.0:1783349785.482124:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659418624 00000100:00100000:1.0:1783349785.482175:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783349785.482181:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659418624:12345-0@lo:101: 00010000:00010000:1.0:1783349785.482188:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349785.482198:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e1f96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1f8f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.482220:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e1f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f8f expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.482229:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e1f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f8f expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.482241:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8cc00, rc 0) 00000100:00100000:1.0:1783349785.482268:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659418624:12345-0@lo:101: Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.482273:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783349785.482343:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659418624:0@lo:101: 00010000:00010000:2.0:1783349785.482353:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.482369:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349785.482406:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659418752:0@lo:501: 00000100:00100000:2.0:1783349785.482425:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.483084:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659418752 00000100:00100000:2.0:1783349785.483084:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3461e89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.483090:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659418752 00000100:00100000:3.0:1783349785.483130:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783349785.483164:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659418752:12345-0@lo:501: 00000100:00100000:3.0:1783349785.483272:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659418752:12345-0@lo:501: Request processed in 136us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.483279:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783349785.483282:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659418752:0@lo:501: 00000100:00100000:2.0:1783349785.483308:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659418880:0@lo:503: 00000100:00100000:2.0:1783349785.483349:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.483366:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659418880 00000100:00100000:0.0:1783349785.483370:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659418880 00000100:00100000:2.0:1783349785.483374:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3461e89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349785.483388:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783349785.483398:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659418880:12345-0@lo:503: 00000100:00100000:0.0:1783349785.483546:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659418880:12345-0@lo:503: Request processed in 152us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.483553:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783349785.483645:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659418880:0@lo:503: 00000100:00100000:2.0:1783349785.484026:0:9977:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9977:1869977659419008:0@lo:502: 00000100:00100000:2.0:1783349785.484061:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.484082:0:9977:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3461e89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.484120:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659419008 00000100:00100000:3.0:1783349785.484124:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659419008 00000100:00100000:3.0:1783349785.488088:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783349785.488110:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:9977:x1869977659419008:12345-0@lo:502: 00000100:00100000:3.0:1783349785.488307:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:9977:x1869977659419008:12345-0@lo:502: Request processed in 206us (4244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.488314:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783349785.488419:0:9977:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9977:1869977659419008:0@lo:502: 00000100:00100000:1.0:1783349785.488499:0:9977:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243766300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9977:1869977659419136:0@lo:502: 00000100:00100000:1.0:1783349785.488542:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349785.490076:0:9977:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc083c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349785.490187:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659419136 00000100:00100000:2.0:1783349785.490195:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659419136 00000100:00100000:2.0:1783349785.490243:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783349785.490251:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:9977:x1869977659419136:12345-0@lo:502: 00000100:00100000:2.0:1783349785.490379:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:9977:x1869977659419136:12345-0@lo:502: Request processed in 128us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.490386:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783349785.490639:0:9977:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243766300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9977:1869977659419136:0@lo:502: 00000040:00080000:1.0:1783349785.490668:0:9977:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1783349785.491917:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1783349785.491948:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349785.491959:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.491983:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349785.491992:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783349785.491995:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea357ed9800 from 6 10000000:01000000:2.0:1783349785.491998:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783349785.492032:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.492040:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.492050:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349785.492069:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659419264:0@lo:101: 00000100:00100000:2.0:1783349785.492121:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.492180:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349785.492260:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659419264 00000100:00100000:0.0:1783349785.492266:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659419264 00000100:00100000:0.0:1783349785.492311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783349785.492326:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659419264:12345-0@lo:101: 00010000:00010000:0.0:1783349785.492339:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349785.492350:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1f9d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.492370:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f9d expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.492380:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f9d expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.492390:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8fc00, rc 0) 00000100:00100000:2.0:1783349785.492849:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659419264:0@lo:101: 00010000:00010000:2.0:1783349785.492866:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.492874:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349785.493526:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659419264:12345-0@lo:101: Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.493537:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659419392:0@lo:256: 00000100:00100000:0.0:1783349785.493538:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783349785.493583:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.493618:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349785.493618:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659419392 00000100:00100000:0.0:1783349785.493624:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659419392 00000100:00100000:0.0:1783349785.493660:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783349785.493667:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659419392:12345-0@lo:256: 20000000:01000000:0.0:1783349785.493684:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783349785.493701:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783349785.493705:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1783349785.493792:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659419392:12345-0@lo:256: Request processed in 124us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.493798:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783349785.493881:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659419392:0@lo:256: 10000000:01000000:1.0:1783349785.493930:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783349785.493938:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.493947:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349785.493956:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783349785.493958:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1783349785.493961:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783349785.493985:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.493992:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.494010:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349785.494022:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243766300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659419520:0@lo:101: 00000100:00100000:1.0:1783349785.494050:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349785.494069:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc083c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.494130:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659419520 00000100:00100000:3.0:1783349785.494163:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659419520 00000100:00100000:3.0:1783349785.494185:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783349785.494191:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659419520:12345-0@lo:101: 00010000:00010000:3.0:1783349785.494200:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349785.494214:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1fab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.494235:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1fab expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.494245:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1fab expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.494252:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341524600, rc 0) 00000100:00100000:3.0:1783349785.494285:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659419520:12345-0@lo:101: Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.494291:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783349785.494319:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243766300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659419520:0@lo:101: 00010000:00010000:3.0:1783349785.494330:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.494350:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349785.494400:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659419648:0@lo:501: 00000100:00100000:3.0:1783349785.494424:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.494527:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659419648 00000100:00100000:0.0:1783349785.494531:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659419648 00000100:00100000:0.0:1783349785.494550:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783349785.494556:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659419648:12345-0@lo:501: 00000100:00100000:0.0:1783349785.494670:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659419648:12345-0@lo:501: Request processed in 113us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.494677:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783349785.494735:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc1f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.494745:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659419648:0@lo:501: 00000100:00100000:3.0:1783349785.494771:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659419776:0@lo:503: 00000100:00100000:3.0:1783349785.494808:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.494828:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc1f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349785.494839:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659419776 00000100:00100000:2.0:1783349785.494843:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659419776 00000100:00100000:2.0:1783349785.494877:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783349785.494884:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659419776:12345-0@lo:503: 00000100:00100000:2.0:1783349785.495103:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659419776:12345-0@lo:503: Request processed in 219us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.495109:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783349785.495175:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659419776:0@lo:503: 00000100:00100000:0.0:1783349785.496558:0:9978:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9978:1869977659419904:0@lo:502: 00000100:00100000:0.0:1783349785.496631:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.496659:0:9978:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.496731:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659419904 00000100:00100000:3.0:1783349785.496737:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659419904 00000100:00100000:3.0:1783349785.496781:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783349785.496790:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:9978:x1869977659419904:12345-0@lo:502: 00000100:00100000:3.0:1783349785.497101:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:9978:x1869977659419904:12345-0@lo:502: Request processed in 311us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.497109:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783349785.497197:0:9978:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9978:1869977659419904:0@lo:502: 00000020:01000000:0.0:1783349785.497226:0:9978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783349785.497234:0:9978:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783349785.497241:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349785.497242:0:9978:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783349785.497247:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783349785.497251:0:9978:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:0.0:1783349785.497272:0:9978:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783349785.497275:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783349785.497288:0:9978:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8ea36d144d40) 00000020:00000080:0.0:1783349785.497310:0:9978:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1783349785.497315:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783349785.497393:0:9978:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1783349785.497400:0:9978:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783349785.497407:0:9978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e1fc0 00010000:00080000:0.0:1783349785.497501:0:9978:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea36da91000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:0.0:1783349785.497803:0:9978:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1783349785.501567:0:9978:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1783349785.501586:0:9978:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1783349785.501791:0:9978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349785.501918:0:9978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349785.502047:0:9978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1783349785.502124:0:9978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1783349785.502882:0:9979:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349785.502887:0:9979:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783349785.506244:0:9978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783349785.506258:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783349785.506303:0:9978:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783349785.506327:0:9978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e1fc7 00000100:00080000:0.0:1783349785.506337:0:9978:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783349785.506343:0:9978:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea36da91000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349785.506377:0:9978:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f48ed80 x1869977659420032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783349785.506406:0:9978:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1783349785.506516:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659420032:0@lo:8: 00000100:00100000:2.0:1783349785.506587:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783349785.506682:0:9978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349785.506688:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349785.506689:0:9978:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783349785.506692:0:9978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349785.506708:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349785.506710:0:9978:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783349785.506713:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783349785.506715:0:9978:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783349785.506738:0:9978:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9978:1869977659420160:0@lo:502: 00000100:00100000:0.0:1783349785.506781:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.506815:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659420160 00000100:00100000:0.0:1783349785.506822:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659420160 00000100:00100000:0.0:1783349785.506860:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783349785.506867:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:9978:x1869977659420160:12345-0@lo:502: 00000100:00100000:0.0:1783349785.506980:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:9978:x1869977659420160:12345-0@lo:502: Request processed in 112us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.506987:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783349785.507025:0:9978:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242784300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349785.507044:0:9978:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9978:1869977659420160:0@lo:502: 00000020:01000000:0.0:1783349785.507069:0:9978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349785.507077:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349785.507078:0:9978:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783349785.507082:0:9978:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1783349785.508579:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1783349785.508612:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783349785.508625:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.508636:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349785.508647:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783349785.508650:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea3461c1000 from 39 10000000:01000000:2.0:1783349785.508653:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783349785.508690:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.508712:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.508721:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349785.508755:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659420288:0@lo:101: 00000100:00100000:2.0:1783349785.508811:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.508850:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349785.508917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659420288 00000100:00100000:0.0:1783349785.508933:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659420288 00000100:00100000:0.0:1783349785.509009:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783349785.509018:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659420288:12345-0@lo:101: 00010000:00010000:0.0:1783349785.509030:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349785.509042:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e1fd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1fce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.509064:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e1fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1fce expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.509075:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e1fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1fce expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.509083:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e400, rc 0) 00000100:00100000:0.0:1783349785.509122:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659420288:12345-0@lo:101: Request processed in 105us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.509128:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783349785.509185:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659420288:0@lo:101: 00010000:00010000:0.0:1783349785.509198:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.509206:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349785.509252:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659420416:0@lo:501: 00000100:00100000:0.0:1783349785.509284:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.509296:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242784900 going to sleep for 11 seconds 00000100:00100000:0.0:1783349785.509307:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659420416 00000100:00100000:0.0:1783349785.509330:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659420416 00000100:00100000:0.0:1783349785.509365:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783349785.509386:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659420416:12345-0@lo:501: 00000100:00100000:0.0:1783349785.509605:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659420416:12345-0@lo:501: Request processed in 232us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.509625:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783349785.509661:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659420416:0@lo:501: 00000100:00100000:3.0:1783349785.510130:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659420672:0@lo:400: 00000100:00100000:0.0:1783349785.510207:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659420544:0@lo:503: 00000100:00100000:1.0:1783349785.510223:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659420032 00000100:00100000:1.0:1783349785.510229:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659420032 00000100:00100000:0.0:1783349785.510262:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.510268:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.510294:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242784900 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.510300:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659421184:0@lo:400: 00000100:00100000:0.0:1783349785.510310:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659420544 00000100:00100000:0.0:1783349785.510316:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659420544 00000100:00100000:3.0:1783349785.510325:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.510345:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659421696:0@lo:400: 00000100:00100000:0.0:1783349785.510347:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783349785.510359:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659420544:12345-0@lo:503: 00000100:00100000:3.0:1783349785.510378:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349785.510399:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783349785.510406:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1869977659420032:12345-0@lo:8: 00000100:00100000:3.0:1783349785.510419:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783349785.510427:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659421056:0@lo:400: 00000100:00100000:3.0:1783349785.510463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.510478:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659421568:0@lo:400: 00000100:00100000:3.0:1783349785.510507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.510516:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659420672 00000100:00100000:2.0:1783349785.510521:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659420672 00000100:00100000:3.0:1783349785.510534:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659420800:0@lo:400: 00000100:00100000:2.0:1783349785.510546:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659421184 00000100:00100000:2.0:1783349785.510550:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659421184 00000100:00100000:3.0:1783349785.510566:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.510577:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659421696 00000100:00100000:2.0:1783349785.510581:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659421696 00000100:00100000:3.0:1783349785.510587:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659421312:0@lo:400: 00000100:00100000:2.0:1783349785.510597:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659421056 00000100:00100000:2.0:1783349785.510602:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659421056 00000100:00100000:3.0:1783349785.510614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.510620:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659421568 00000100:00100000:2.0:1783349785.510624:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659421568 00000100:00100000:3.0:1783349785.510638:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783349785.510646:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659420928:0@lo:400: 00000100:00100000:2.0:1783349785.510646:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783349785.510658:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659420672:12345-0@lo:400: 00000100:00100000:3.0:1783349785.510670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.510682:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659421440:0@lo:400: 00000100:00100000:3.0:1783349785.510707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.510730:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783349785.510737:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1783349785.510755:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659420928 00000100:00100000:3.0:1783349785.510758:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659420928 00000100:00100000:3.0:1783349785.510781:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783349785.510787:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659421184:12345-0@lo:400: 00000100:00100000:0.0:1783349785.511016:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659420544:12345-0@lo:503: Request processed in 658us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.511024:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783349785.511072:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659420544:0@lo:503: 00010000:00080000:1.0:1783349785.511122:0:8432:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1783349785.511173:0:8432:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e1fdc 00002000:00100000:1.0:1783349785.511187:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8ea375e0b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1783349785.511191:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1783349785.511195:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1783349785.511250:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1783349785.511550:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659420672:12345-0@lo:400: Request processed in 893us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.511559:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783349785.511574:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349785.511582:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659421696:12345-0@lo:400: 00000100:00100000:3.0:1783349785.511710:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659421184:12345-0@lo:400: Request processed in 922us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.511718:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783349785.511734:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783349785.511741:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659421056:12345-0@lo:400: 00000100:00100000:3.0:1783349785.511775:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659421056:12345-0@lo:400: Request processed in 34us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.511784:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659421696:12345-0@lo:400: Request processed in 201us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.511798:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783349785.511995:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349785.512010:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349785.512017:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659421568:12345-0@lo:400: 00000100:00100000:3.0:1783349785.512023:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783349785.512034:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659420928:12345-0@lo:400: 00000100:00100000:2.0:1783349785.512059:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659421568:12345-0@lo:400: Request processed in 42us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.512076:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783349785.512087:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659420928:12345-0@lo:400: Request processed in 54us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.512094:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1783349785.512100:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349785.512106:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783349785.512132:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659420800 00000100:00100000:3.0:1783349785.512155:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659420800 00000100:00100000:3.0:1783349785.512187:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783349785.512194:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659420800:12345-0@lo:400: 00000100:00100000:3.0:1783349785.512351:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659420800:12345-0@lo:400: Request processed in 157us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.512358:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783349785.512377:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783349785.512383:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659421312 00000100:00100000:3.0:1783349785.512386:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659421312 00000100:00100000:3.0:1783349785.512416:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783349785.512421:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659421440 00000100:00100000:3.0:1783349785.512424:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659421440 00000100:00100000:3.0:1783349785.512444:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783349785.512451:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349785.512457:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659421312:12345-0@lo:400: 00000100:00100000:3.0:1783349785.512489:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659421312:12345-0@lo:400: Request processed in 31us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.512495:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349785.512504:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783349785.512510:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783349785.512516:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659421440:12345-0@lo:400: 00000100:00100000:3.0:1783349785.512559:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659421440:12345-0@lo:400: Request processed in 43us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.512567:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00080000:1.0:1783349785.512567:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1783349785.512597:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8ea375e08000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1783349785.512610:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243720700 x1869977659420928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349785.512624:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659420928:0@lo:400: 00000100:00100000:1.0:1783349785.512644:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1869977659420032:12345-0@lo:8: Request processed in 2236us (6057us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.512652:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1783349785.512773:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243722680 x1869977659421440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783349785.512782:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48ed80 x1869977659420032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783349795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349785.512786:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659421440:0@lo:400: 00000100:00100000:1.0:1783349785.512800:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1783349785.512805:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659420800:0@lo:400: 00000100:00080000:1.0:1783349785.512816:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00010000:00080000:3.0:1783349785.512821:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243723800 x1869977659421312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783349785.512827:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:3.0:1783349785.512832:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659421312:0@lo:400: 00000100:00080000:1.0:1783349785.512834:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783349785.512839:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36da91000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783349785.512854:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783349785.512860:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659420032:0@lo:8: 00000004:00080000:1.0:1783349785.512887:0:9979:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783349785.512949:0:9979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 226307812038ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783349785.512955:0:9979:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1783349785.513535:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349785.513575:0:9980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1869977659421824:0@lo:700: 00000100:00100000:2.0:1783349785.513613:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.513640:0:9980:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227300 going to sleep for 11 seconds 00010000:00080000:0.0:1783349785.514091:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243723100 x1869977659420672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.514104:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659420672:0@lo:400: 00010000:00080000:0.0:1783349785.514121:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243721880 x1869977659421184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.514151:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659421184:0@lo:400: 00010000:00080000:0.0:1783349785.514173:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243721c00 x1869977659421696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.514182:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659421696:0@lo:400: 00010000:00080000:0.0:1783349785.514201:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243723b80 x1869977659421056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.514209:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659421056:0@lo:400: 00010000:00080000:0.0:1783349785.514222:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243720000 x1869977659421568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.514229:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659421568:0@lo:400: 00000100:00100000:3.0:1783349785.514360:0:9982:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243045c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9982:1869977659421952:0@lo:502: 00000100:00100000:3.0:1783349785.514404:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.514529:0:9982:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc1f600 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.514613:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659421824 00000100:00100000:1.0:1783349785.514619:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659421824 00000100:00100000:1.0:1783349785.514667:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783349785.514675:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9980:x1869977659421824:12345-0@lo:700: 00000100:00100000:1.0:1783349785.514976:0:8441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243765180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8441:1869977659422080:0@lo:700: 00000100:00100000:1.0:1783349785.515006:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349785.515645:0:8441:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc08480 going to sleep for 11 seconds 00000100:00080000:1.0:1783349785.515660:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349785.515868:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659422080 00000100:00100000:2.0:1783349785.515875:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659422080 00000100:00100000:2.0:1783349785.515986:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349785.515996:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8441:x1869977659422080:12345-0@lo:700: 00000100:00100000:0.0:1783349785.517047:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659421952 00000100:00100000:0.0:1783349785.517056:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659421952 00000100:00100000:0.0:1783349785.517146:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783349785.517154:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:9982:x1869977659421952:12345-0@lo:502: 00000100:00100000:0.0:1783349785.517317:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:9982:x1869977659421952:12345-0@lo:502: Request processed in 164us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.517325:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783349785.517369:0:9982:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243045c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9982:1869977659421952:0@lo:502: 00000100:00100000:2.0:1783349785.517486:0:9982:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9982:1869977659422208:0@lo:502: 00000100:00100000:2.0:1783349785.517554:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349785.517580:0:9982:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc1f600 going to sleep for 11 seconds 00000004:00080000:3.0:1783349785.517605:0:7448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1783349785.517912:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659422208 00000100:00100000:0.0:1783349785.517918:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659422208 00000100:00100000:0.0:1783349785.518035:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783349785.518042:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:9982:x1869977659422208:12345-0@lo:502: 00000100:00100000:0.0:1783349785.518123:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:9982:x1869977659422208:12345-0@lo:502: Request processed in 81us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.518178:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783349785.518256:0:9982:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9982:1869977659422208:0@lo:502: 00000040:00080000:1.0:1783349785.518277:0:9982:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1783349785.518495:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1783349785.518516:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783349785.518525:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.518535:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349785.518544:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783349785.518547:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea3461c1000 from 6 10000000:01000000:0.0:1783349785.518550:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783349785.518572:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.518580:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.518588:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349785.518600:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659422336:0@lo:101: 00000100:00100000:0.0:1783349785.518626:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.518685:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242784cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349785.525578:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659422336 00000100:00100000:2.0:1783349785.525596:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659422336 00000100:00100000:2.0:1783349785.525874:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783349785.525886:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659422336:12345-0@lo:101: 00010000:00010000:2.0:1783349785.525905:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349785.525926:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e1fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1fe3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.525954:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e1fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1fe3 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.525965:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e1fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1fe3 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349785.525982:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd200, rc 0) 00000100:00100000:2.0:1783349785.526071:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659422336:12345-0@lo:101: Request processed in 188us (7443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.526079:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783349785.526200:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659422336:0@lo:101: 00010000:00010000:0.0:1783349785.526220:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349785.526230:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349785.526299:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659422464:0@lo:256: 00000100:00100000:0.0:1783349785.526337:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.526365:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242784cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349785.526412:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659422464 00000100:00100000:2.0:1783349785.526417:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659422464 00000100:00100000:2.0:1783349785.526529:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783349785.526535:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659422464:12345-0@lo:256: 20000000:01000000:2.0:1783349785.526548:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783349785.526564:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783349785.526568:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 40000000:02000000:0.0:1783349785.526872:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1783349785.527520:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659422464:12345-0@lo:256: Request processed in 107us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.527530:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783349785.531643:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659422464:0@lo:256: 00000100:00100000:0.0:1783349785.531779:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8441:x1869977659422080:12345-0@lo:700: Request processed in 15783us (16769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.531790:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783349785.531833:0:8441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243765180 x1869977659422080/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783349801 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.531845:0:8441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243765180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8441:1869977659422080:0@lo:700: 40000000:02000000:0.0:1783349785.531854:0:8441:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 10000000:01000000:3.0:1783349785.533964:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783349785.533980:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.533993:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349785.534021:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783349785.534024:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1783349785.534027:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783349785.534061:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.534069:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.534079:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349785.534099:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659422592:0@lo:101: 00000100:00100000:3.0:1783349785.534175:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.534212:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508c1300 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.534234:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659422592 00000100:00100000:3.0:1783349785.534241:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659422592 00000100:00100000:3.0:1783349785.534299:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783349785.534307:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659422592:12345-0@lo:101: 00010000:00010000:3.0:1783349785.534322:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349785.534334:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea38215f800/0xd05e6ae1590e1ff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e1ff1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.534356:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea38215f800/0xd05e6ae1590e1ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e1ff1 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.534367:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea38215f800/0xd05e6ae1590e1ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1ff1 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.534387:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea38215f800, rc 0) 00000100:00100000:3.0:1783349785.534426:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659422592:12345-0@lo:101: Request processed in 119us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.534432:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783349785.534484:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659422592:0@lo:101: 00010000:00010000:3.0:1783349785.534498:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349785.534506:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349785.534556:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659422720:0@lo:501: 00000100:00100000:3.0:1783349785.534579:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.534588:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1783349785.534810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659422720 00000100:00100000:2.0:1783349785.534815:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659422720 00000100:00100000:2.0:1783349785.534839:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783349785.534846:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659422720:12345-0@lo:501: 00000100:00100000:2.0:1783349785.534964:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659422720:12345-0@lo:501: Request processed in 119us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.534971:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783349785.535064:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659422720:0@lo:501: 00000100:00100000:3.0:1783349785.535090:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659422848:0@lo:503: 00000100:00100000:3.0:1783349785.535128:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.535174:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1783349785.535319:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659422848 00000100:00100000:2.0:1783349785.535323:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659422848 00000100:00100000:2.0:1783349785.535352:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783349785.535359:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659422848:12345-0@lo:503: 00000100:00100000:2.0:1783349785.535433:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659422848:12345-0@lo:503: Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.535458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783349785.535930:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659422848:0@lo:503: 00000100:00100000:3.0:1783349785.536852:0:9983:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9983:1869977659422976:0@lo:502: 00000100:00100000:3.0:1783349785.536903:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.536940:0:9983:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1783349785.536988:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659422976 00000100:00100000:2.0:1783349785.536993:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659422976 00000100:00100000:2.0:1783349785.537029:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783349785.537037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:9983:x1869977659422976:12345-0@lo:502: 00000100:00100000:2.0:1783349785.537245:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:9983:x1869977659422976:12345-0@lo:502: Request processed in 207us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.537263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783349785.537531:0:9983:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9983:1869977659422976:0@lo:502: 00000020:01000000:1.0:1783349785.537558:0:9983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783349785.537565:0:9983:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783349785.537572:0:9983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349785.537574:0:9983:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783349785.537579:0:9983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783349785.537584:0:9983:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:1.0:1783349785.537613:0:9983:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783349785.537621:0:9983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783349785.537634:0:9983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ea241dc8000) 00000020:00000080:1.0:1783349785.537656:0:9983:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1783349785.537662:0:9983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783349785.537797:0:9983:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783349785.537803:0:9983:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783349785.537809:0:9983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e2006 00010000:00080000:1.0:1783349785.537846:0:9983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea24321d800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783349785.538058:0:9983:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1783349785.538268:0:9983:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783349785.538280:0:9983:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783349785.538506:0:9983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783349785.538615:0:9983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783349785.538805:0:9983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783349785.538913:0:9983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000001:00100000:3.0:1783349785.540429:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1783349785.540927:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9980:x1869977659421824:12345-0@lo:700: Request processed in 26247us (27307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.540940:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783349785.541018:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea379139c00 x1869977659421824/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783349801 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349785.541042:0:9980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1869977659421824:0@lo:700: 00000040:00080000:0.0:1783349785.542656:0:9984:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349785.542663:0:9984:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783349785.544688:0:9983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783349785.544702:0:9983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783349785.544743:0:9983:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783349785.544769:0:9983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e200d 00000100:00080000:0.0:1783349785.544780:0:9983:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783349785.544787:0:9983:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ea24321d800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349785.544835:0:9983:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea37f48f480 x1869977659423104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783349785.544861:0:9983:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783349785.544917:0:9983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349785.544922:0:9983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349785.544924:0:9983:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783349785.544933:0:9983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349785.544938:0:9983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349785.544939:0:9983:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783349785.544943:0:9983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783349785.544944:0:9983:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783349785.544973:0:9983:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9983:1869977659423232:0@lo:502: 00000100:00100000:0.0:1783349785.545053:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.545085:0:9983:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.546575:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659423104:0@lo:8: 00000100:00100000:1.0:1783349785.546632:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349785.546679:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659423104 00000100:00100000:3.0:1783349785.546687:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659423104 00000100:00100000:1.0:1783349785.546692:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659423232 00000100:00100000:1.0:1783349785.546697:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659423232 00000100:00100000:1.0:1783349785.546741:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783349785.546749:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:9983:x1869977659423232:12345-0@lo:502: 00000100:00100000:3.0:1783349785.546842:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349785.546849:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659423104:12345-0@lo:8: 00000100:00100000:1.0:1783349785.546875:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:9983:x1869977659423232:12345-0@lo:502: Request processed in 124us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.546884:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00080000:3.0:1783349785.546913:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000100:00100000:1.0:1783349785.546944:0:9983:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:9983:1869977659423232:0@lo:502: 00000020:00000080:3.0:1783349785.546946:0:8431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e2014 00002000:00100000:3.0:1783349785.546961:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ea24325e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783349785.546966:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783349785.546969:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1783349785.546976:0:9983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349785.546985:0:9983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349785.546987:0:9983:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783349785.546992:0:9983:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00002000:00080000:3.0:1783349785.547037:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783349785.547060:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ea24325f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349785.547115:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1869977659423104:12345-0@lo:8: Request processed in 265us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.547124:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:1.0:1783349785.547128:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1783349785.547179:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00080000:3.0:1783349785.547183:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48f480 x1869977659423104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783349795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783349785.547190:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349785.547196:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783349785.547204:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00010000:00010000:1.0:1783349785.547206:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783349785.547212:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 10000000:01000000:1.0:1783349785.547218:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00000100:00080000:3.0:1783349785.547219:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783349785.547224:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24321d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783349785.547224:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ea349f8b380 from 1 10000000:01000000:1.0:1783349785.547231:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000004:00080000:3.0:1783349785.547252:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00010000:1.0:1783349785.547258:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349785.547259:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659423104:0@lo:8: 00010000:00010000:1.0:1783349785.547271:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.547280:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349785.547297:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659423360:0@lo:101: 00000100:00100000:1.0:1783349785.547330:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349785.547354:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc08f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.547368:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659423360 00000100:00100000:1.0:1783349785.547371:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659423360 00000100:00100000:1.0:1783349785.547398:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783349785.547404:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659423360:12345-0@lo:101: 00010000:00010000:1.0:1783349785.547412:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349785.547423:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e2022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e201b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.547467:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e2022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e201b expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.547477:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e2022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e201b expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.547486:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d600, rc 0) 00000100:00100000:1.0:1783349785.547515:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659423360:12345-0@lo:101: Request processed in 111us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.547521:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783349785.547552:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659423360:0@lo:101: 00010000:00010000:1.0:1783349785.547565:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.547574:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783349785.547617:0:9984:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783349785.547682:0:9984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 226342544030ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783349785.547689:0:9984:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783349785.547855:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659423488:0@lo:501: 00000100:00100000:1.0:1783349785.547881:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349785.547896:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc08f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.547911:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659423488 00000100:00100000:1.0:1783349785.547914:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659423488 00000100:00100000:1.0:1783349785.547937:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783349785.547944:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659423488:12345-0@lo:501: 00000100:00100000:1.0:1783349785.548001:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659423488:12345-0@lo:501: Request processed in 57us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783349785.548016:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783349785.548047:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659423488:0@lo:501: 10000000:01000000:1.0:1783349785.548075:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783349785.548080:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349785.548088:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349785.550684:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:0.0:1783349785.550713:0:9980:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1783349785.550751:0:9980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1869977659423744:0@lo:7: 00000100:00100000:0.0:1783349785.550819:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.550851:0:9980:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a000 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.551334:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659423616:0@lo:13: 00000100:00100000:1.0:1783349785.551366:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349785.551396:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659423616 00000100:00100000:1.0:1783349785.551402:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659423616 00000100:00100000:3.0:1783349785.551625:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659423744 00000100:00100000:3.0:1783349785.551640:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659423744 00000100:00100000:1.0:1783349785.551689:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349785.551694:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349785.551704:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9980:x1869977659423744:12345-0@lo:7: 00000100:00100000:1.0:1783349785.551903:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869977659423616:12345-0@lo:13: 00002000:00000024:1.0:1783349785.551988:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:1.0:1783349785.552085:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869977659423616:12345-0@lo:13: Request processed in 185us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.552093:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783349785.552245:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48f480 x1869977659423616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.552332:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659423616:0@lo:13: 00000004:00080000:0.0:1783349785.556131:0:9985:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783349785.556169:0:9985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1869977659424000:0@lo:7: 00000100:00100000:0.0:1783349785.556225:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.556260:0:9985:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a540 going to sleep for 11 seconds 00000100:00100000:2.0:1783349785.556573:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659423872:0@lo:13: 00000100:00100000:2.0:1783349785.556613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1783349785.557394:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783349785.557401:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783349785.557473:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9980:x1869977659423744:12345-0@lo:7: Request processed in 5769us (6651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.557483:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349785.557506:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659424000 00000100:00100000:3.0:1783349785.557513:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659424000 00000100:00100000:3.0:1783349785.557571:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783349785.557581:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9985:x1869977659424000:12345-0@lo:7: 00010000:00080000:1.0:1783349785.557588:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48dc00 x1869977659423744/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783349801 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349785.557604:0:9980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1869977659423744:0@lo:7: 00000004:00080000:1.0:1783349785.557615:0:9980:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1783349785.557648:0:9980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243766d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1869977659424128:0@lo:5: 00000100:00100000:1.0:1783349785.557681:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349785.557713:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659424128 00000100:00100000:1.0:1783349785.557717:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659424128 00000100:00100000:1.0:1783349785.557739:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349785.557746:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9980:x1869977659424128:12345-0@lo:5: 00002000:00080000:1.0:1783349785.557763:0:9981:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1783349785.557796:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9980:x1869977659424128:12345-0@lo:5: Request processed in 50us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.557804:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349785.557822:0:9980:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc08f00 going to sleep for 11 seconds 00010000:00080000:1.0:1783349785.557873:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243766d80 x1869977659424128/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349801 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349785.557883:0:9980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243766d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1869977659424128:0@lo:5: 00000004:00080000:1.0:1783349785.557892:0:9980:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00080000:2.0:1783349785.557917:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349785.558057:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659423872 00000100:00100000:0.0:1783349785.558061:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659423872 00000100:00100000:0.0:1783349785.558095:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783349785.558102:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1869977659423872:12345-0@lo:13: 00002000:00000024:0.0:1783349785.558126:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:0.0:1783349785.558180:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1869977659423872:12345-0@lo:13: Request processed in 78us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349785.558194:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1783349785.558278:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48f480 x1869977659423872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349785.558295:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659423872:0@lo:13: 00000004:00080000:1.0:1783349785.558733:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783349785.558830:0:9980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243766d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1869977659424256:0@lo:5: 00000100:00100000:1.0:1783349785.558872:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349785.558898:0:9980:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc08f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783349785.558923:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659424256 00000100:00100000:2.0:1783349785.558929:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659424256 00000100:00100000:2.0:1783349785.558952:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349785.558958:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9980:x1869977659424256:12345-0@lo:5: 00002000:00080000:2.0:1783349785.558984:0:9981:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1783349785.562568:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9980:x1869977659424256:12345-0@lo:5: Request processed in 3603us (3690us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783349785.562580:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1783349785.563799:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243766d80 x1869977659424256/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349801 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.563883:0:9980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243766d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1869977659424256:0@lo:5: 00000004:00080000:0.0:1783349785.563897:0:9980:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1783349785.563939:0:9980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9980:1869977659424384:0@lo:900: 00000100:00100000:0.0:1783349785.563988:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.564025:0:9980:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a480 going to sleep for 11 seconds 00002000:00080000:3.0:1783349785.564170:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1783349785.564176:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783349785.564217:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9985:x1869977659424000:12345-0@lo:7: Request processed in 6637us (7990us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349785.564225:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783349785.564617:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659424384 00000100:00100000:2.0:1783349785.564630:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659424384 00000100:00100000:2.0:1783349785.564673:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349785.564680:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9980:x1869977659424384:12345-0@lo:900: 00000100:00100000:2.0:1783349785.564724:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9980:x1869977659424384:12345-0@lo:900: Request processed in 44us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349785.564729:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783349785.564790:0:9985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48ed80 x1869977659424000/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783349801 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.564802:0:9985:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1869977659424000:0@lo:7: 00000004:00080000:0.0:1783349785.564812:0:9985:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1783349785.564838:0:9985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1869977659424512:0@lo:5: 00000100:00100000:0.0:1783349785.564863:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.564882:0:9985:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a540 going to sleep for 11 seconds 00010000:00080000:0.0:1783349785.564901:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48df80 x1869977659424384/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783349801 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349785.564909:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659424512 00000100:00100000:0.0:1783349785.564910:0:9980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9980:1869977659424384:0@lo:900: 00000100:00100000:1.0:1783349785.564913:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659424512 00000100:00100000:1.0:1783349785.564974:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349785.564982:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9985:x1869977659424512:12345-0@lo:5: 00002000:00080000:1.0:1783349785.564999:0:8431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1783349785.565003:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1783349785.567866:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1783349785.567886:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1783349785.567894:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783349785.568200:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9985:x1869977659424512:12345-0@lo:5: Request processed in 3214us (3331us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783349785.568211:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1783349785.568280:0:9985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48ed80 x1869977659424512/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349801 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.568293:0:9985:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783349785.568310:0:9985:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1869977659424512:0@lo:5: 00000004:00080000:0.0:1783349785.568325:0:9985:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783349785.568372:0:9985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1869977659424640:0@lo:700: 00000100:00100000:0.0:1783349785.568407:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.568475:0:9985:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a540 going to sleep for 11 seconds 00000100:00100000:1.0:1783349785.568518:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659424640 00000100:00100000:1.0:1783349785.568530:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659424640 00000100:00100000:1.0:1783349785.568616:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783349785.568626:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9985:x1869977659424640:12345-0@lo:700: 00000100:00100000:1.0:1783349785.576363:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9985:x1869977659424640:12345-0@lo:700: Request processed in 7730us (7947us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349785.576379:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783349785.576482:0:9985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48ed80 x1869977659424640/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783349801 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.576497:0:9985:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1869977659424640:0@lo:700: 00000004:02000040:0.0:1783349785.578000:0:9985:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1783349785.583225:0:9985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1869977659424768:0@lo:5: 00000100:00100000:0.0:1783349785.583314:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349785.583358:0:9985:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a540 going to sleep for 11 seconds 00000100:00100000:3.0:1783349785.583708:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659424768 00000100:00100000:3.0:1783349785.583717:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659424768 00000100:00100000:3.0:1783349785.583776:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783349785.583788:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9985:x1869977659424768:12345-0@lo:5: 00002000:00080000:3.0:1783349785.591064:0:9981:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1783349785.591083:0:9981:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1783349785.593040:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9985:x1869977659424768:12345-0@lo:5: Request processed in 9248us (9718us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783349785.593053:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783349785.593274:0:9985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48ed80 x1869977659424768/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349801 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349785.593294:0:9985:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9985:1869977659424768:0@lo:5: 00000004:00080000:0.0:1783349785.593315:0:9985:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:3.0:1783349785.911949:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1783349786.245816:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783349786.692663:0:10035:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783349786.692896:0:10035:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783349787.014297:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659424896:0@lo:13: 00000100:00100000:2.0:1783349787.014379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349787.014462:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659424896 00000100:00100000:2.0:1783349787.014469:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659424896 00000100:00100000:2.0:1783349787.014512:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783349787.014521:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659424896:12345-0@lo:13: 00002000:00000024:2.0:1783349787.014547:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349787.014584:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659424896:12345-0@lo:13: Request processed in 64us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349787.014591:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1783349787.014607:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783349787.014632:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea379139500 x1869977659424896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349787.014649:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659424896:0@lo:13: 00000100:00100000:2.0:1783349787.015442:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659425024:0@lo:13: 00000100:00100000:2.0:1783349787.015480:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349787.015560:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659425024 00000100:00100000:0.0:1783349787.015565:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659425024 00000100:00100000:0.0:1783349787.015615:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783349787.015624:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659425024:12345-0@lo:13: 00002000:00000024:0.0:1783349787.015638:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349787.015668:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659425024:12345-0@lo:13: Request processed in 45us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349787.015674:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1783349787.015751:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783349787.015772:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437a2a00 x1869977659425024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349787.015793:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659425024:0@lo:13: 00010000:00010000:2.0:1783349787.268537:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783349787.628568:0:10083:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783349787.628595:0:10083:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1783349787.986739:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349787.986944:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642598528 00000100:00100000:1.0:1783349787.986954:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642598528 00000100:00100000:1.0:1783349787.987002:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 178 00000100:00100000:1.0:1783349787.987011:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1869977642598528:12345-192.168.203.50@tcp:250: 00010000:00080000:1.0:1783349787.987037:0:6512:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9adf8385-2fc7-4e71-b2a6-262a64a4b4cf@192.168.203.50@tcp t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:1.0:1783349787.987080:0:6512:0:(genops.c:1406:class_connect()) connect: client 9adf8385-2fc7-4e71-b2a6-262a64a4b4cf, cookie 0xd05e6ae1590e2029 00000100:00080000:1.0:1783349787.987250:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8ea24321a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349787.987311:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+5:2398:x1869977642598528:12345-192.168.203.50@tcp:250: Request processed in 299us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349787.987318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 178 00000100:00100000:1.0:1783349788.001021:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349788.001120:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642598656 00000100:00100000:2.0:1783349788.001130:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642598656 00000100:00100000:2.0:1783349788.001236:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 179 00000100:00100000:2.0:1783349788.001247:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+5:6153:x1869977642598656:12345-192.168.203.50@tcp:101: 00010000:00010000:2.0:1783349788.001274:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349788.001294:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e2030 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decd1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.001324:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e2030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd1a expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.001336:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e2030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd1a expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.001346:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc600, rc 0) 00000100:00100000:2.0:1783349788.001396:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+6:6153:x1869977642598656:12345-192.168.203.50@tcp:101: Request processed in 150us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.001403:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 179 00000100:00100000:0.0:1783349788.021400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349788.021517:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642598784 00000100:00100000:2.0:1783349788.021527:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642598784 00000100:00100000:2.0:1783349788.021637:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 180 00000100:00100000:2.0:1783349788.021648:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+6:6153:x1869977642598784:12345-192.168.203.50@tcp:501: 00000100:00100000:2.0:1783349788.021788:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+6:6153:x1869977642598784:12345-192.168.203.50@tcp:501: Request processed in 142us (400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783349788.021812:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 180 00000100:00100000:0.0:1783349788.023896:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349788.024234:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642598912 00000100:00100000:1.0:1783349788.024244:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642598912 00000100:00100000:0.0:1783349788.024428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 181 00000100:00100000:0.0:1783349788.024439:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+6:6153:x1869977642598912:12345-192.168.203.50@tcp:101: 00010000:00010000:0.0:1783349788.024457:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349788.024474:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2037 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decd21 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.024503:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd21 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.024513:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd21 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.024523:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ee00, rc 0) 00000100:00100000:0.0:1783349788.024579:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+7:6153:x1869977642598912:12345-192.168.203.50@tcp:101: Request processed in 141us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349788.024586:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 181 00000100:00100000:1.0:1783349788.026990:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349788.027176:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642599040 00000100:00100000:2.0:1783349788.027185:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642599040 00000100:00100000:2.0:1783349788.027244:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 182 00000100:00100000:2.0:1783349788.027253:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+7:6153:x1869977642599040:12345-192.168.203.50@tcp:501: 00000100:00100000:2.0:1783349788.027521:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+8:6153:x1869977642599040:12345-192.168.203.50@tcp:501: Request processed in 267us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.027529:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 182 00000100:00100000:1.0:1783349788.030660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349788.030750:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642599168 00000100:00100000:2.0:1783349788.030761:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642599168 00000100:00100000:2.0:1783349788.030817:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 183 00000100:00100000:2.0:1783349788.030826:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+8:6153:x1869977642599168:12345-192.168.203.50@tcp:503: 00000100:00100000:2.0:1783349788.030977:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+8:6153:x1869977642599168:12345-192.168.203.50@tcp:503: Request processed in 151us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.030985:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 183 00000100:00100000:1.0:1783349788.033905:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349788.034003:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642599296 00000100:00100000:0.0:1783349788.034021:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642599296 00000100:00100000:0.0:1783349788.034077:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 184 00000100:00100000:0.0:1783349788.034086:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+8:6171:x1869977642599296:12345-192.168.203.50@tcp:502: 00000100:00100000:0.0:1783349788.034275:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+8:6171:x1869977642599296:12345-192.168.203.50@tcp:502: Request processed in 189us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349788.034282:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 184 00000100:00100000:1.0:1783349788.055041:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349788.055124:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642599424 00000100:00100000:3.0:1783349788.055167:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642599424 00000100:00100000:3.0:1783349788.055227:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 185 00000100:00100000:3.0:1783349788.055236:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+8:6171:x1869977642599424:12345-192.168.203.50@tcp:502: 00000100:00100000:3.0:1783349788.055385:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+8:6171:x1869977642599424:12345-192.168.203.50@tcp:502: Request processed in 149us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349788.055393:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 185 00000100:00100000:1.0:1783349788.060986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349788.061312:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642599552 00000100:00100000:2.0:1783349788.061321:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642599552 00000100:00100000:2.0:1783349788.061381:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 186 00000100:00100000:2.0:1783349788.061391:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+8:6153:x1869977642599552:12345-192.168.203.50@tcp:101: 00010000:00010000:2.0:1783349788.061408:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349788.061434:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e203e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decd52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.061464:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e203e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd52 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.061491:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e203e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd52 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.061500:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc000, rc 0) 00000100:00100000:2.0:1783349788.061554:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6153:x1869977642599552:12345-192.168.203.50@tcp:101: Request processed in 165us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.061561:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 186 00000100:00100000:1.0:1783349788.064627:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349788.065536:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642599680 00000100:00100000:0.0:1783349788.065564:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642599680 00000100:00100000:0.0:1783349788.065627:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 187 00000100:00100000:0.0:1783349788.065650:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6153:x1869977642599680:12345-192.168.203.50@tcp:256: 20000000:01000000:0.0:1783349788.065688:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783349788.065712:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783349788.065717:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783349788.065721:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783349788.065724:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783349788.065726:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1783349788.067231:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6153:x1869977642599680:12345-192.168.203.50@tcp:256: Request processed in 1588us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349788.067243:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 187 00000100:00100000:1.0:1783349788.069948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349788.070220:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642599808 00000100:00100000:3.0:1783349788.070231:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642599808 00000100:00100000:3.0:1783349788.070281:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 188 00000100:00100000:3.0:1783349788.070290:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6153:x1869977642599808:12345-192.168.203.50@tcp:101: 00010000:00010000:3.0:1783349788.070305:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349788.070322:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2045 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decd59 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.070355:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd59 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.070367:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd59 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.070377:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea38215fc00, rc 0) 00000100:00100000:3.0:1783349788.070495:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6153:x1869977642599808:12345-192.168.203.50@tcp:101: Request processed in 205us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349788.070502:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 188 00000100:00100000:1.0:1783349788.072620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349788.072729:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642599936 00000100:00100000:2.0:1783349788.072737:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642599936 00000100:00100000:2.0:1783349788.072795:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 189 00000100:00100000:2.0:1783349788.072805:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6153:x1869977642599936:12345-192.168.203.50@tcp:501: 00000100:00100000:2.0:1783349788.073244:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6153:x1869977642599936:12345-192.168.203.50@tcp:501: Request processed in 439us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.073252:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 189 00000100:00100000:1.0:1783349788.074989:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349788.075205:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642600064 00000100:00100000:0.0:1783349788.075214:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642600064 00000100:00100000:0.0:1783349788.075305:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 190 00000100:00100000:0.0:1783349788.075315:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6153:x1869977642600064:12345-192.168.203.50@tcp:503: 00000100:00100000:0.0:1783349788.075518:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6153:x1869977642600064:12345-192.168.203.50@tcp:503: Request processed in 204us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349788.075526:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 190 00000100:00100000:1.0:1783349788.078765:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349788.078866:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642600192 00000100:00100000:2.0:1783349788.078879:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642600192 00000100:00100000:2.0:1783349788.078931:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 191 00000100:00100000:2.0:1783349788.078942:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6175:x1869977642600192:12345-192.168.203.50@tcp:502: 00000100:00100000:2.0:1783349788.079294:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6175:x1869977642600192:12345-192.168.203.50@tcp:502: Request processed in 353us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.079303:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 191 00000100:00100000:1.0:1783349788.081728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349788.081822:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642600320 00000100:00100000:0.0:1783349788.081831:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642600320 00000100:00100000:0.0:1783349788.081923:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 192 00000100:00100000:0.0:1783349788.081933:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6175:x1869977642600320:12345-192.168.203.50@tcp:502: 00000100:00100000:0.0:1783349788.082097:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6175:x1869977642600320:12345-192.168.203.50@tcp:502: Request processed in 164us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349788.082105:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 192 00000100:00100000:1.0:1783349788.086383:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349788.086579:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349788.086775:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642600448 00000100:00100000:2.0:1783349788.086785:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642600448 00000100:00100000:2.0:1783349788.086869:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642600704 00000100:00100000:2.0:1783349788.086873:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642600704 00000100:00100000:3.0:1783349788.086912:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1783349788.086921:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1869977642600448:12345-192.168.203.50@tcp:38: 00010000:00080000:3.0:1783349788.086953:0:6518:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:3.0:1783349788.087004:0:6518:0:(genops.c:1406:class_connect()) connect: client 689af055-7605-419d-81ba-26cff8cb556b, cookie 0xd05e6ae1590e204c 00000004:00100000:3.0:1783349788.087057:0:6518:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783349788.087281:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ea24325d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349788.087352:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2398:x1869977642600448:12345-192.168.203.50@tcp:38: Request processed in 429us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349788.087360:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1783349788.087379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:3.0:1783349788.087385:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1869977642600704:12345-192.168.203.50@tcp:38: 00010000:00080000:3.0:1783349788.087413:0:6518:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:3.0:1783349788.087451:0:6518:0:(genops.c:1406:class_connect()) connect: client 689af055-7605-419d-81ba-26cff8cb556b, cookie 0xd05e6ae1590e2053 00000004:00100000:3.0:1783349788.087464:0:6518:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783349788.087588:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349788.087613:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2398:x1869977642600704:12345-192.168.203.50@tcp:38: Request processed in 227us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349788.087620:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00010000:00010000:1.0:1783349788.292486:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349789.060814:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349789.060851:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659425152:0@lo:41: 00000100:00100000:2.0:1783349789.060922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349789.061222:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659425152 00000100:00100000:3.0:1783349789.061230:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659425152 00000100:00100000:3.0:1783349789.061279:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783349789.061288:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659425152:12345-0@lo:41: 00000004:00000024:3.0:1783349789.061321:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783349789.061369:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659425152:12345-0@lo:41: Request processed in 82us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349789.061376:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783349789.063291:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659425152:0@lo:41: 00000100:00100000:1.0:1783349789.091956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349789.092040:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642600960 00000100:00100000:0.0:1783349789.092061:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642600960 00000100:00100000:0.0:1783349789.092171:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:0.0:1783349789.092182:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:6153:x1869977642600960:12345-192.168.203.50@tcp:41: 00000004:00000024:0.0:1783349789.092214:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783349789.092280:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:6153:x1869977642600960:12345-192.168.203.50@tcp:41: Request processed in 101us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349789.092288:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00080000:2.0:1783349789.092394:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349789.093297:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349789.093332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349789.093405:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642600832 00000100:00100000:0.0:1783349789.093422:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642600832 00000100:00100000:0.0:1783349789.093487:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642600576 00000100:00100000:0.0:1783349789.093491:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642600576 00000100:00100000:0.0:1783349789.093517:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1783349789.093527:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+6:0:x1869977642600832:12345-192.168.203.50@tcp:41: 00000004:00000024:0.0:1783349789.093557:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783349789.093624:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+6:0:x1869977642600832:12345-192.168.203.50@tcp:41: Request processed in 98us (331us total) trans 0 rc 0/0 00000100:00080000:2.0:1783349789.093732:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349789.094996:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:2.0:1783349789.096574:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1783349789.096740:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:0:x1869977642600576:12345-192.168.203.50@tcp:41: 00000004:00000024:2.0:1783349789.096859:0:8582:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783349789.096936:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:0:x1869977642600576:12345-192.168.203.50@tcp:41: Request processed in 347us (3601us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349789.096945:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:1.0:1783349789.098317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349789.100779:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642601088 00000100:00100000:2.0:1783349789.100794:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642601088 00000100:00100000:2.0:1783349789.100870:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:2.0:1783349789.100880:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:6153:x1869977642601088:12345-192.168.203.50@tcp:40: 00000100:00100000:2.0:1783349789.100976:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:6153:x1869977642601088:12345-192.168.203.50@tcp:40: Request processed in 97us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349789.100983:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:2.0:1783349789.103399:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349789.103495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349789.103584:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642601600 00000100:00100000:1.0:1783349789.103603:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642601600 00000100:00100000:1.0:1783349789.103659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 193 00000100:00100000:1.0:1783349789.103669:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2401:x1869977642601600:12345-192.168.203.50@tcp:400: 00000100:00100000:1.0:1783349789.103733:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2401:x1869977642601600:12345-192.168.203.50@tcp:400: Request processed in 65us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349789.103740:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 193 00000100:00100000:3.0:1783349789.109623:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642601472 00000100:00100000:3.0:1783349789.109643:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642601472 00000100:00100000:3.0:1783349789.109706:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1783349789.109716:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:689af055-7605-419d-81ba-26cff8cb556b+6:6153:x1869977642601472:12345-192.168.203.50@tcp:900: 00000100:00100000:3.0:1783349789.109821:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:689af055-7605-419d-81ba-26cff8cb556b+6:6153:x1869977642601472:12345-192.168.203.50@tcp:900: Request processed in 106us (6428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349789.109829:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:2.0:1783349789.110021:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349789.110103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349789.110157:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642601216 00000100:00100000:0.0:1783349789.110162:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642601216 00000100:00100000:0.0:1783349789.110194:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642601344 00000100:00100000:0.0:1783349789.110197:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642601344 00000100:00100000:0.0:1783349789.110212:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:0.0:1783349789.110218:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1869977642601216:12345-192.168.203.50@tcp:8: 00010000:00080000:0.0:1783349789.110244:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1783349789.110273:0:8431:0:(genops.c:1406:class_connect()) connect: client 689af055-7605-419d-81ba-26cff8cb556b, cookie 0xd05e6ae1590e205a 00002000:00100000:0.0:1783349789.110286:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 689af055-7605-419d-81ba-26cff8cb556b/ffff8ea2434d9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783349789.110312:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783349789.110534:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783349789.110563:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ea2434dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349789.110600:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2398:x1869977642601216:12345-192.168.203.50@tcp:8: Request processed in 381us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349789.110607:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:0.0:1783349789.110624:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:0.0:1783349789.110628:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1869977642601344:12345-192.168.203.50@tcp:8: 00010000:00080000:0.0:1783349789.110645:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1783349789.110661:0:8431:0:(genops.c:1406:class_connect()) connect: client 689af055-7605-419d-81ba-26cff8cb556b, cookie 0xd05e6ae1590e2061 00002000:00100000:0.0:1783349789.110666:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 689af055-7605-419d-81ba-26cff8cb556b/ffff8ea2434da000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783349789.110676:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783349789.110896:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783349789.110912:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ea2434de800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349789.110940:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2398:x1869977642601344:12345-192.168.203.50@tcp:8: Request processed in 309us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349789.110947:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:2.0:1783349789.113325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349789.113504:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642601728 00000100:00100000:0.0:1783349789.113514:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642601728 00000100:00100000:0.0:1783349789.113836:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:0.0:1783349789.113847:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+6:6153:x1869977642601728:12345-192.168.203.50@tcp:33: 00000004:00080000:0.0:1783349789.135860:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 21931us 00000004:00200000:0.0:1783349789.162129:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783349789.162255:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+6:6153:x1869977642601728:12345-192.168.203.50@tcp:33: Request processed in 48405us (48933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349789.162278:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00010000:00010000:2.0:1783349789.316303:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349789.331845:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349789.331948:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642601856 00000100:00100000:3.0:1783349789.331966:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642601856 00000100:00100000:3.0:1783349789.332023:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1783349789.332033:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:6193:x1869977642601856:12345-192.168.203.50@tcp:101: 00010000:00010000:3.0:1783349789.332061:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349789.332084:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e2068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decd8a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349789.332185:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e206f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349789.332197:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e206f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349789.332211:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e206f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349789.332256:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783349789.332259:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349789.332274:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e206f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349789.332296:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e2068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd8a expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349789.332313:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e206f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd8a expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349789.332334:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea34459e900) 00010000:00010000:3.0:1783349789.332337:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349789.332341:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f1000, rc 0) 00000100:00100000:3.0:1783349789.332401:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+7:6193:x1869977642601856:12345-192.168.203.50@tcp:101: Request processed in 370us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349789.332417:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00010000:00010000:2.0:1783349790.341107:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349790.596568:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349790.596595:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659425408:0@lo:41: 00000100:00100000:1.0:1783349790.596675:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349790.596825:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659425280:0@lo:13: 00000100:00100000:2.0:1783349790.596877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349790.598045:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349790.598061:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659425536:0@lo:13: 00000100:00100000:1.0:1783349790.598106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349790.598160:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659425280 00000100:00100000:1.0:1783349790.598166:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659425280 00000100:00100000:1.0:1783349790.598206:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659425536 00000100:00100000:1.0:1783349790.598217:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659425536 00000100:00100000:1.0:1783349790.598235:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349790.598253:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659425280:12345-0@lo:13: 00002000:00000024:1.0:1783349790.598281:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349790.598319:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659425280:12345-0@lo:13: Request processed in 77us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349790.598326:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349790.598341:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1783349790.598426:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783349790.598460:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437a1500 x1869977659425280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349790.598476:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783349790.598498:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659425280:0@lo:13: 00000100:00100000:1.0:1783349790.598559:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659425536:12345-0@lo:13: 00002000:00000024:1.0:1783349790.598573:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349790.598613:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659425536:12345-0@lo:13: Request processed in 266us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349790.598619:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1783349790.598733:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243764000 x1869977659425536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349790.598741:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1783349790.598762:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659425536:0@lo:13: 00000100:00100000:3.0:1783349790.602470:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659425408 00000100:00100000:3.0:1783349790.602485:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659425408 00000100:00100000:3.0:1783349790.602564:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783349790.603575:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659425664:0@lo:400: 00000100:00100000:0.0:1783349790.603718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349790.603755:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659426176:0@lo:400: 00000100:00100000:0.0:1783349790.603781:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349790.603800:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659426688:0@lo:400: 00000100:00100000:0.0:1783349790.603820:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349790.603841:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783349790.603847:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659425792:0@lo:400: 00000100:00100000:0.0:1783349790.603868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349790.603885:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659426304:0@lo:400: 00000100:00100000:0.0:1783349790.603903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349790.604214:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659426816:0@lo:400: 00000100:00100000:0.0:1783349790.604314:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349790.604347:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659425664 00000100:00100000:0.0:1783349790.604354:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659425664 00000100:00100000:0.0:1783349790.604411:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1783349790.604420:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659425664:12345-0@lo:400: 00000100:00100000:0.0:1783349790.604472:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659425664:12345-0@lo:400: Request processed in 52us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349790.604480:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1783349790.604509:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659426176 00000100:00100000:0.0:1783349790.604514:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659426176 00000100:00100000:0.0:1783349790.604542:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659426688 00000100:00100000:0.0:1783349790.604546:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659426688 00000100:00100000:0.0:1783349790.604570:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659425792 00000100:00100000:0.0:1783349790.604574:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659425792 00000100:00100000:0.0:1783349790.604583:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659426304 00000100:00100000:0.0:1783349790.604585:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659426304 00000100:00100000:0.0:1783349790.604596:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659426816 00000100:00100000:0.0:1783349790.604598:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659426816 00000100:00100000:0.0:1783349790.604611:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783349790.604617:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659426176:12345-0@lo:400: 00000100:00100000:2.0:1783349790.605015:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659426048:0@lo:400: 00000100:00100000:2.0:1783349790.605051:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349790.605067:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659426560:0@lo:400: 00000100:00100000:2.0:1783349790.605090:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349790.605111:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783349790.605118:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659425920:0@lo:400: 00000100:00100000:2.0:1783349790.605161:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349790.605180:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659426432:0@lo:400: 00000100:00100000:2.0:1783349790.605206:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349790.605233:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659426560 00000100:00100000:2.0:1783349790.605237:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659426560 00000100:00100000:2.0:1783349790.605265:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659426432 00000100:00100000:2.0:1783349790.605268:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659426432 00000100:00100000:2.0:1783349790.605287:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783349790.605295:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659426560:12345-0@lo:400: 00000100:00100000:2.0:1783349790.605334:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659426560:12345-0@lo:400: Request processed in 40us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349790.605349:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783349790.605362:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349790.605369:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659426432:12345-0@lo:400: 00000100:00100000:2.0:1783349790.605408:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659426432:12345-0@lo:400: Request processed in 31us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349790.605415:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349790.605437:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659425920 00000100:00100000:2.0:1783349790.605441:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659425920 00000100:00100000:0.0:1783349790.605456:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659426176:12345-0@lo:400: Request processed in 837us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349790.605464:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783349790.605479:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659426048 00000100:00100000:0.0:1783349790.605484:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659426048 00000100:00100000:0.0:1783349790.605503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783349790.605516:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659425408:12345-0@lo:41: 00000100:00100000:0.0:1783349790.605517:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659426688:12345-0@lo:400: 00000004:00000024:3.0:1783349790.605553:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783349790.605558:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659426688:12345-0@lo:400: Request processed in 46us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349790.605566:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783349790.605577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783349790.605582:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659425792:12345-0@lo:400: 00000100:00100000:0.0:1783349790.605608:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659425792:12345-0@lo:400: Request processed in 25us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349790.605613:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783349790.605697:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783349790.605707:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659426304:12345-0@lo:400: 00000100:00100000:0.0:1783349790.605738:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659426304:12345-0@lo:400: Request processed in 33us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349790.605743:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783349790.605764:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783349790.605769:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659426816:12345-0@lo:400: 00000100:00100000:0.0:1783349790.605796:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659426816:12345-0@lo:400: Request processed in 27us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349790.605802:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783349790.605813:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783349790.605819:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659426048:12345-0@lo:400: 00000100:00100000:0.0:1783349790.605845:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659426048:12345-0@lo:400: Request processed in 27us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349790.605850:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783349790.605886:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659425792:0@lo:400: 00010000:00080000:0.0:1783349790.605899:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437a3100 x1869977659426304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349790.605911:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659426304:0@lo:400: 00010000:00080000:0.0:1783349790.606102:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437a1880 x1869977659426816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349790.606111:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659426816:0@lo:400: 00000100:00100000:0.0:1783349790.606122:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659425664:0@lo:400: 00000100:00100000:0.0:1783349790.606132:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659426176:0@lo:400: 00000100:00100000:0.0:1783349790.606161:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659426688:0@lo:400: 00000100:00080000:0.0:1783349790.606189:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349790.606194:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349790.606197:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783349790.606365:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437a1f80 x1869977659426432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349790.606381:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659426432:0@lo:400: 00000100:00100000:0.0:1783349790.606393:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659426048:0@lo:400: 00010000:00080000:0.0:1783349790.606416:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437a0700 x1869977659426560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349790.606423:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659426560:0@lo:400: 00000100:00100000:2.0:1783349790.609498:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783349790.609523:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659425920:12345-0@lo:400: 00000100:00100000:2.0:1783349790.609770:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659425920:12345-0@lo:400: Request processed in 258us (4608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349790.609777:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783349790.610035:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659425408:12345-0@lo:41: Request processed in 4526us (13359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349790.610043:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783349790.610768:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659425920:0@lo:400: 00000100:00100000:0.0:1783349790.610794:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659425408:0@lo:41: 00000100:00100000:1.0:1783349791.253202:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349791.253427:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642601984 00000100:00100000:0.0:1783349791.253438:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642601984 00000100:00100000:0.0:1783349791.253515:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:0.0:1783349791.253524:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+7:6245:x1869977642601984:12345-192.168.203.50@tcp:41: 00000004:00000024:0.0:1783349791.253584:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783349791.253668:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+7:6245:x1869977642601984:12345-192.168.203.50@tcp:41: Request processed in 144us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349791.253676:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00080000:2.0:1783349791.253829:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349791.257997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349791.258092:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642602112 00000100:00100000:0.0:1783349791.258104:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642602112 00000100:00100000:0.0:1783349791.258282:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:0.0:1783349791.258293:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:6245:x1869977642602112:12345-192.168.203.50@tcp:41: 00000004:00000024:0.0:1783349791.258329:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:2.0:1783349791.258574:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349791.258668:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:6245:x1869977642602112:12345-192.168.203.50@tcp:41: Request processed in 376us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349791.258676:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:3.0:1783349791.266174:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349791.266813:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642602240 00000100:00100000:2.0:1783349791.266825:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642602240 00000100:00100000:2.0:1783349791.266902:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:2.0:1783349791.266913:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:689af055-7605-419d-81ba-26cff8cb556b+6:6245:x1869977642602240:12345-192.168.203.50@tcp:13: 00002000:00000024:2.0:1783349791.266947:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349791.267021:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:689af055-7605-419d-81ba-26cff8cb556b+6:6245:x1869977642602240:12345-192.168.203.50@tcp:13: Request processed in 111us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349791.267029:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00080000:0.0:1783349791.267257:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349791.272187:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349791.272277:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642602368 00000100:00100000:2.0:1783349791.272288:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642602368 00000100:00100000:2.0:1783349791.272367:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:2.0:1783349791.272388:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:689af055-7605-419d-81ba-26cff8cb556b+6:6245:x1869977642602368:12345-192.168.203.50@tcp:13: 00002000:00000024:2.0:1783349791.272439:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349791.272504:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:689af055-7605-419d-81ba-26cff8cb556b+6:6245:x1869977642602368:12345-192.168.203.50@tcp:13: Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349791.272512:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00080000:0.0:1783349791.273426:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783349791.367266:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349792.137699:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659426944:0@lo:13: 00000100:00100000:0.0:1783349792.137774:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349792.137862:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659426944 00000100:00100000:0.0:1783349792.137870:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659426944 00000100:00100000:0.0:1783349792.137927:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783349792.137935:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659426944:12345-0@lo:13: 00002000:00000024:0.0:1783349792.137960:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349792.138005:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659426944:12345-0@lo:13: Request processed in 70us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349792.138013:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1783349792.138034:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783349792.138156:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243044700 x1869977659426944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349792.138175:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659426944:0@lo:13: 00000100:00100000:1.0:1783349792.141572:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349792.141599:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659427072:0@lo:13: 00000100:00100000:1.0:1783349792.141801:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349792.142397:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659427072 00000100:00100000:1.0:1783349792.142406:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659427072 00000100:00100000:1.0:1783349792.142467:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783349792.142477:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659427072:12345-0@lo:13: 00002000:00000024:1.0:1783349792.142501:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349792.142550:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659427072:12345-0@lo:13: Request processed in 75us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349792.142565:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1783349792.142589:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783349792.142616:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243766d80 x1869977659427072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349792.142796:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659427072:0@lo:13: 00010000:00010000:2.0:1783349792.388574:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783349793.161766:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00010000:00010000:2.0:1783349793.412374:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783349793.536421:0:10181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1783349794.180672:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659427200:0@lo:41: 00000100:00100000:2.0:1783349794.180747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349794.180843:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659427200 00000100:00100000:2.0:1783349794.180850:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659427200 00000100:00100000:2.0:1783349794.180908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783349794.180918:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659427200:12345-0@lo:41: 00000004:00000024:2.0:1783349794.180954:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783349794.181010:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659427200:12345-0@lo:41: Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349794.181018:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783349794.181087:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659427200:0@lo:41: 00000001:00100000:0.0:1783349794.185037:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000001:00100000:3.0:1783349794.185388:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000100:00100000:3.0:1783349794.392123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349794.392204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349794.392931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349794.392962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349794.392993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349794.393024:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642602880 00000100:00100000:3.0:1783349794.393034:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642602880 00000100:00100000:3.0:1783349794.393088:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642603008 00000100:00100000:3.0:1783349794.393091:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642603008 00000100:00100000:3.0:1783349794.393132:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:3.0:1783349794.393174:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642602880:12345-192.168.203.50@tcp:400: 00000100:00100000:3.0:1783349794.393243:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642602880:12345-192.168.203.50@tcp:400: Request processed in 71us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349794.393251:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:3.0:1783349794.393267:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:3.0:1783349794.393273:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642603008:12345-192.168.203.50@tcp:400: 00000100:00100000:3.0:1783349794.393299:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642603008:12345-192.168.203.50@tcp:400: Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349794.393356:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00080000:3.0:1783349794.393384:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349794.393388:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349794.393560:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642602624 00000100:00100000:0.0:1783349794.393565:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642602624 00000100:00100000:0.0:1783349794.393605:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642602752 00000100:00100000:0.0:1783349794.393609:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642602752 00000100:00100000:0.0:1783349794.393635:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:0.0:1783349794.393643:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642602624:12345-192.168.203.50@tcp:400: 00000100:00100000:0.0:1783349794.393678:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642602624:12345-192.168.203.50@tcp:400: Request processed in 36us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349794.393685:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:0.0:1783349794.393698:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:0.0:1783349794.393712:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642602752:12345-192.168.203.50@tcp:400: 00000100:00100000:0.0:1783349794.393738:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642602752:12345-192.168.203.50@tcp:400: Request processed in 27us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349794.393744:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00080000:3.0:1783349794.394210:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349794.394214:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349794.394410:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642602496 00000100:00100000:2.0:1783349794.394416:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642602496 00000100:00100000:2.0:1783349794.394759:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 195 00000100:00100000:2.0:1783349794.394768:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2401:x1869977642602496:12345-192.168.203.50@tcp:400: 00000100:00100000:2.0:1783349794.394858:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2401:x1869977642602496:12345-192.168.203.50@tcp:400: Request processed in 91us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349794.394865:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 195 00010000:00010000:1.0:1783349794.437315:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783349795.212058:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00010000:00010000:2.0:1783349795.460225:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349795.716328:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659427328:0@lo:41: 00000100:00100000:0.0:1783349795.716444:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349795.718306:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659427456:0@lo:13: 00000100:00100000:0.0:1783349795.718378:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349795.718545:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659427456 00000100:00100000:0.0:1783349795.718553:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659427456 00000100:00100000:0.0:1783349795.718607:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783349795.718616:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659427456:12345-0@lo:13: 00002000:00000024:0.0:1783349795.718645:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349795.718648:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659427584:0@lo:13: 00000100:00100000:2.0:1783349795.718690:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349795.718695:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659427456:12345-0@lo:13: Request processed in 79us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349795.718703:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783349795.718724:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659427584 00000100:00100000:0.0:1783349795.718727:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659427584 00010000:00080000:2.0:1783349795.718742:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437a1f80 x1869977659427456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349795.718750:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783349795.718760:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659427584:12345-0@lo:13: 00000100:00100000:2.0:1783349795.718770:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659427456:0@lo:13: 00002000:00000024:0.0:1783349795.718771:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349795.718808:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659427584:12345-0@lo:13: Request processed in 48us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349795.718814:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783349795.718929:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2438b8e00 x1869977659427584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349795.718942:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659427584:0@lo:13: 00000100:00100000:0.0:1783349795.719195:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659427712:0@lo:400: 00000100:00100000:3.0:1783349795.719234:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659427328 00000100:00100000:3.0:1783349795.719240:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659427328 00000100:00100000:0.0:1783349795.719240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349795.719281:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783349795.719289:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659427328:12345-0@lo:41: 00000100:00100000:2.0:1783349795.719291:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659428096:0@lo:400: 00000100:00100000:0.0:1783349795.719291:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659428224:0@lo:400: 00000004:00000024:3.0:1783349795.719313:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783349795.720784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349795.720842:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659428736:0@lo:400: 00000100:00100000:0.0:1783349795.720888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349795.721481:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659427328:12345-0@lo:41: Request processed in 2187us (5032us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349795.721493:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1783349795.721682:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349795.722243:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783349795.722257:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659427840:0@lo:400: 00000100:00100000:0.0:1783349795.722304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349795.722331:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659428352:0@lo:400: 00000100:00100000:0.0:1783349795.722354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349795.722384:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659428864:0@lo:400: 00000100:00100000:0.0:1783349795.722405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349795.722423:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659427968:0@lo:400: 00000100:00100000:0.0:1783349795.722436:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659427712 00000100:00100000:0.0:1783349795.722445:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659427712 00000100:00100000:3.0:1783349795.722461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349795.722492:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659428480:0@lo:400: 00000100:00100000:0.0:1783349795.722496:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1783349795.722508:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659427712:12345-0@lo:400: 00000100:00100000:3.0:1783349795.722534:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349795.722573:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659427712:12345-0@lo:400: Request processed in 66us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349795.722574:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659428480 00000100:00100000:3.0:1783349795.722580:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659428480 00000100:00100000:0.0:1783349795.722585:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783349795.722619:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783349795.722622:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659428224 00000100:00100000:3.0:1783349795.722628:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659428480:12345-0@lo:400: 00000100:00100000:0.0:1783349795.722628:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659428224 00000100:00100000:0.0:1783349795.722657:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659428736 00000100:00100000:0.0:1783349795.722661:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659428736 00000100:00100000:3.0:1783349795.722677:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659428480:12345-0@lo:400: Request processed in 49us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349795.722678:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659427840 00000100:00100000:0.0:1783349795.722683:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659427840 00000100:00100000:3.0:1783349795.722687:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783349795.722699:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659428352 00000100:00100000:0.0:1783349795.722703:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659428352 00000100:00080000:3.0:1783349795.722712:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349795.722718:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349795.722720:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659428864 00000100:00080000:3.0:1783349795.722721:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349795.722725:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659428864 00010000:00080000:3.0:1783349795.722750:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243047100 x1869977659428480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349795.722765:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659428480:0@lo:400: 00000100:00100000:0.0:1783349795.722765:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783349795.722777:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659428224:12345-0@lo:400: 00000100:00100000:0.0:1783349795.722813:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659428224:12345-0@lo:400: Request processed in 39us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349795.722820:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783349795.722835:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783349795.722841:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659428736:12345-0@lo:400: 00000100:00100000:0.0:1783349795.722870:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659428736:12345-0@lo:400: Request processed in 30us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349795.722876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783349795.722892:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783349795.722900:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659427840:12345-0@lo:400: 00000100:00100000:3.0:1783349795.723188:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659427968 00000100:00100000:3.0:1783349795.723193:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659427968 00000100:00100000:3.0:1783349795.723218:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783349795.723224:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659427968:12345-0@lo:400: 00000100:00100000:3.0:1783349795.723263:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659427968:12345-0@lo:400: Request processed in 39us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349795.723269:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783349795.723295:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659427968:0@lo:400: 00000100:00100000:0.0:1783349795.723802:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659427840:12345-0@lo:400: Request processed in 903us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349795.723811:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783349795.723829:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783349795.723836:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659428352:12345-0@lo:400: 00000100:00100000:0.0:1783349795.723868:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659428352:12345-0@lo:400: Request processed in 33us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349795.723873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783349795.723885:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783349795.723890:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659428864:12345-0@lo:400: 00000100:00100000:0.0:1783349795.723916:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659428864:12345-0@lo:400: Request processed in 26us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349795.723922:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1783349795.723959:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783349795.724946:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349795.725008:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659428096 00000100:00100000:2.0:1783349795.725015:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659428096 00000100:00100000:2.0:1783349795.725070:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783349795.725078:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659428096:12345-0@lo:400: 00000100:00100000:2.0:1783349795.725154:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659428096:12345-0@lo:400: Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349795.725162:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783349795.725202:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659428096:0@lo:400: 00000100:00100000:2.0:1783349795.725214:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659428608:0@lo:400: 00000100:00100000:2.0:1783349795.725245:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349795.725267:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659428608 00000100:00100000:2.0:1783349795.725270:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659428608 00000100:00100000:2.0:1783349795.725311:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1783349795.725314:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349795.725318:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659428608:12345-0@lo:400: 00000100:00100000:2.0:1783349795.725608:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659428608:12345-0@lo:400: Request processed in 289us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349795.725621:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1783349795.725650:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243045c00 x1869977659428608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349795.725661:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659428608:0@lo:400: 00000100:00100000:0.0:1783349795.730806:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659427328:0@lo:41: 00000100:00100000:0.0:1783349795.733335:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659427840:0@lo:400: 00010000:00080000:0.0:1783349795.733368:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243044700 x1869977659428352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349795.733380:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659428352:0@lo:400: 00010000:00080000:0.0:1783349795.733392:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243723b80 x1869977659428864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349795.733400:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659428864:0@lo:400: 00000100:00100000:0.0:1783349795.733412:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659428736:0@lo:400: 00000100:00100000:0.0:1783349795.733423:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659427712:0@lo:400: 00000100:00100000:0.0:1783349795.733435:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659428224:0@lo:400: 00010000:00010000:2.0:1783349796.484372:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783349796.692718:0:10329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd9be4590 20000000:00000080:1.0:1783349796.692740:0:10329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ea243031c00 uarg=0000000000000000 20000000:01000000:1.0:1783349796.692783:0:10329:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1783349796.692785:0:10329:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1783349796.692788:0:10329:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1783349796.692792:0:10329:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1783349796.692797:0:10329:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1783349796.692861:0:10329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783349796.692864:0:10329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783349796.694610:0:10330:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1783349796.694988:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1783349796.695021:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1783349796.695037:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1783349796.695050:0:10329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783349796.695052:0:10329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783349796.695936:0:10331:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1783349796.696978:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1783349796.697033:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1783349796.697054:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1783349796.697101:0:10329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783349796.697105:0:10329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783349796.698624:0:10332:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1783349796.699336:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1783349796.699384:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1783349796.699555:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1783349796.699573:0:10329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783349796.699576:0:10329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783349796.700070:0:10333:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1783349796.700601:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1783349796.700625:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1783349796.700640:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1783349796.700652:0:10329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783349796.700662:0:10329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783349796.700928:0:10334:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1783349796.701076:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1783349796.701095:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1783349796.701109:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:0.0:1783349796.701122:0:10329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783349796.703021:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703048:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e1f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f0a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703055:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e1f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f34 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703063:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e1f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f73 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703070:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f81 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703077:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e1f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f8f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703084:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1fab expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703090:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e1fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1fce expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703097:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea38215f800/0xd05e6ae1590e1ff8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1ff1 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703119:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e2022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e201b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703128:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e2030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd1a expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703438:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd21 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703449:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703494:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd21 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703510:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2037 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd21 expref: 9 pid: 6512 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.703526:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659428992:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349796.703667:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e2030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd1a expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703676:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e2030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd1a expref: 9 pid: 6510 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.703694:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429120:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349796.703728:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e2022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e201b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703748:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e2022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e201b expref: 23 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.703758:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429248:0@lo:104: 00000100:00100000:0.0:1783349796.703810:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349796.703853:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea38215f800/0xd05e6ae1590e1ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1ff1 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703860:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea38215f800/0xd05e6ae1590e1ff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ff1 expref: 23 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.703868:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429376:0@lo:104: 00000100:00100000:0.0:1783349796.703890:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349796.703921:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e1fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1fce expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703929:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e1fd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1fce expref: 23 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.703937:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429504:0@lo:104: 00000100:00100000:0.0:1783349796.703958:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349796.703974:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1fab expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.703982:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1fb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1fab expref: 23 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.703990:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429632:0@lo:104: 00000100:00100000:0.0:1783349796.704020:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349796.704036:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e1f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1f8f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.704044:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e1f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f8f expref: 23 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.704051:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429760:0@lo:104: 00010000:00010000:0.0:1783349796.704067:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1f81 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.704071:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f81 expref: 23 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.704076:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429888:0@lo:104: 00010000:00010000:0.0:1783349796.704085:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e1f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1f73 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.704089:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e1f7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f73 expref: 23 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.704093:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659430016:0@lo:104: 00010000:00010000:0.0:1783349796.704102:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e1f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1f34 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.704106:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e1f3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f34 expref: 23 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.704110:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659430144:0@lo:104: 00010000:00010000:0.0:1783349796.704120:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e1f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1f0a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.704130:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e1f11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f0a expref: 23 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.704158:0:10329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659430272:0@lo:104: 00000100:00100000:0.0:1783349796.704190:0:10329:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f0bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349796.704291:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783349796.704311:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.704323:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.704332:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.704339:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.704368:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.704381:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659429248 00000100:00100000:2.0:1783349796.704388:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659429248 00000100:00100000:2.0:1783349796.704427:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659429376 00000100:00100000:2.0:1783349796.704430:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659429376 00000100:00100000:2.0:1783349796.704439:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659429504 00000100:00100000:2.0:1783349796.704442:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659429504 00000100:00100000:2.0:1783349796.704449:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659429632 00000100:00100000:2.0:1783349796.704451:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659429632 00000100:00100000:2.0:1783349796.704459:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659429760 00000100:00100000:2.0:1783349796.704461:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659429760 00000100:00100000:2.0:1783349796.704468:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659429888 00000100:00100000:2.0:1783349796.704470:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659429888 00000100:00100000:2.0:1783349796.704478:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659430016 00000100:00100000:2.0:1783349796.704480:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659430016 00000100:00100000:2.0:1783349796.704488:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659430144 00000100:00100000:2.0:1783349796.704490:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659430144 00000100:00100000:2.0:1783349796.704498:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659430272 00000100:00100000:2.0:1783349796.704499:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659430272 00000100:00100000:2.0:1783349796.704522:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783349796.704530:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:10329:x1869977659429248:12345-0@lo:104: 00010000:00010000:2.0:1783349796.704541:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.704595:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783349796.704600:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:10329:x1869977659429248:12345-0@lo:104: Request processed in 72us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.704606:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783349796.704621:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349796.704627:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:10329:x1869977659429376:12345-0@lo:104: 00010000:00010000:2.0:1783349796.704634:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.704666:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783349796.704671:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+10:10329:x1869977659429376:12345-0@lo:104: Request processed in 45us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.704677:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349796.704688:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349796.704693:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:10329:x1869977659429504:12345-0@lo:104: 00010000:00010000:2.0:1783349796.704700:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.704742:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783349796.704747:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+9:10329:x1869977659429504:12345-0@lo:104: Request processed in 55us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.704753:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349796.704771:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349796.704777:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea242723450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+8:10329:x1869977659429632:12345-0@lo:104: 00010000:00010000:2.0:1783349796.704784:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.704811:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783349796.704816:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea242723450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+8:10329:x1869977659429632:12345-0@lo:104: Request processed in 40us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.704822:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349796.704850:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349796.704856:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+7:10329:x1869977659429760:12345-0@lo:104: 00010000:00010000:2.0:1783349796.704862:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.704885:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1783349796.704890:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+7:10329:x1869977659429760:12345-0@lo:104: Request processed in 35us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.704895:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349796.704904:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783349796.704909:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:10329:x1869977659429888:12345-0@lo:104: 00010000:00010000:2.0:1783349796.704916:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.704938:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1783349796.704942:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:10329:x1869977659429888:12345-0@lo:104: Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.704948:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783349796.704964:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349796.704970:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:10329:x1869977659430016:12345-0@lo:104: 00010000:00010000:2.0:1783349796.704977:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705009:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1783349796.705013:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:10329:x1869977659430016:12345-0@lo:104: Request processed in 44us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.705018:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349796.705030:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783349796.705036:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:10329:x1869977659430144:12345-0@lo:104: 00010000:00010000:2.0:1783349796.705042:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705066:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1783349796.705070:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:10329:x1869977659430144:12345-0@lo:104: Request processed in 36us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.705075:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783349796.705085:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783349796.705089:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:10329:x1869977659430272:12345-0@lo:104: 00010000:00010000:2.0:1783349796.705095:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705117:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1783349796.705121:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:10329:x1869977659430272:12345-0@lo:104: Request processed in 32us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.705126:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1783349796.705170:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00000100:00100000:0.0:1783349796.705170:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429248:0@lo:104: 00010000:00010000:2.0:1783349796.705175:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.705181:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429376:0@lo:104: 00010000:00010000:2.0:1783349796.705183:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8de00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349796.705187:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.705188:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429504:0@lo:104: 00000100:00100000:0.0:1783349796.705194:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429632:0@lo:104: 00010000:00010000:2.0:1783349796.705196:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.705200:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429760:0@lo:104: 10000000:00010000:2.0:1783349796.705204:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.705206:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429888:0@lo:104: 10000000:01000000:2.0:1783349796.705210:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783349796.705212:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659430016:0@lo:104: 00000100:00100000:0.0:1783349796.705217:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659430144:0@lo:104: 00000100:00100000:0.0:1783349796.705224:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659430272:0@lo:104: 00010000:00010000:2.0:1783349796.705239:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705245:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349796.705268:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705276:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e201b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e2022 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705287:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783349796.705290:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705295:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea38215ee00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349796.705298:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705310:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349796.705316:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349796.705322:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349796.705336:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705341:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349796.705347:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705363:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea38215ee00/0xd05e6ae1590e1ff1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705374:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783349796.705378:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705383:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cde00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349796.705386:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705393:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349796.705399:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349796.705410:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349796.705426:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705431:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349796.705447:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705454:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cde00/0xd05e6ae1590e1fce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1fd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705463:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783349796.705466:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705471:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8dc00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349796.705474:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705481:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349796.705487:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349796.705492:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349796.705504:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705509:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349796.705521:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705527:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e1fab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1fb2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705534:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783349796.705537:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705542:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fe00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349796.705544:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705549:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349796.705555:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349796.705560:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349796.705571:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705577:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349796.705581:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705587:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fe00/0xd05e6ae1590e1f8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f96 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705595:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783349796.705604:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705610:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349796.705613:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705620:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349796.705627:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349796.705631:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349796.705645:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705650:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349796.705654:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705660:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e1f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f88 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705668:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783349796.705671:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705677:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582ccc00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349796.705679:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705695:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349796.705701:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349796.705706:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349796.705720:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705725:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349796.705729:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705735:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582ccc00/0xd05e6ae1590e1f73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705743:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349796.705746:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705751:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349796.705754:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705760:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349796.705766:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349796.705777:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349796.705790:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705795:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349796.705800:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705806:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea341525000/0xd05e6ae1590e1f34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f3b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705816:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349796.705818:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705823:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525c00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349796.705825:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705832:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349796.705837:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349796.705843:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349796.705853:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705858:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349796.705869:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705875:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea341525c00/0xd05e6ae1590e1f0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f11 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.705887:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349796.705889:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349796.705891:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349796.705900:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349796.705906:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349796.705925:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659430528:0@lo:103: 00000100:00100000:2.0:1783349796.705969:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.705997:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659431040:0@lo:103: 00000100:00100000:2.0:1783349796.706017:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.706054:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783349796.706060:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659430400:0@lo:103: 00000100:00100000:2.0:1783349796.706080:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.706093:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659430912:0@lo:103: 00000100:00100000:2.0:1783349796.706109:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.706125:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659431424:0@lo:103: 00000100:00100000:2.0:1783349796.706168:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.706187:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659430656:0@lo:103: 00000100:00100000:2.0:1783349796.706207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.706216:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659431168:0@lo:103: 00000100:00100000:2.0:1783349796.706230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.706240:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783349796.706251:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659430784:0@lo:103: 00000100:00100000:2.0:1783349796.706272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.706281:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659431296:0@lo:103: 00000100:00100000:2.0:1783349796.706316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349796.706341:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659430528 00000100:00100000:2.0:1783349796.706347:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659430528 00010000:00010000:2.0:1783349796.706388:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea38215f800/0xd05e6ae1590e1ff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ff1 expref: 24 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349796.706405:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659431040 00000100:00100000:2.0:1783349796.706408:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659431040 00010000:00010000:2.0:1783349796.706433:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f81 expref: 25 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349796.706444:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659430400 00000100:00100000:2.0:1783349796.706446:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659430400 00010000:00010000:2.0:1783349796.706456:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e2022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e201b expref: 26 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349796.706464:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659430912 00000100:00100000:2.0:1783349796.706466:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659430912 00010000:00010000:2.0:1783349796.706474:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e1f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f8f expref: 27 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349796.706482:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659431424 00000100:00100000:2.0:1783349796.706484:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659431424 00010000:00010000:2.0:1783349796.706492:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e1f11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f0a expref: 28 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349796.706500:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659430656 00000100:00100000:2.0:1783349796.706502:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659430656 00010000:00010000:2.0:1783349796.706509:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e1fd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1fce expref: 29 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349796.706525:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659431168 00000100:00100000:2.0:1783349796.706527:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659431168 00010000:00010000:2.0:1783349796.706536:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e1f7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f73 expref: 30 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349796.706544:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659430784 00000100:00100000:2.0:1783349796.706547:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659430784 00010000:00010000:2.0:1783349796.706555:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1fb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1fab expref: 31 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349796.706563:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659431296 00000100:00100000:2.0:1783349796.706565:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659431296 00010000:00010000:2.0:1783349796.706573:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e1f3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f34 expref: 32 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349796.706583:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783349796.706590:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea35094a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+32:3649:x1869977659430528:12345-0@lo:103: 00010000:00010000:2.0:1783349796.706601:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349796.706606:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea38215f800/0xd05e6ae1590e1ff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ff1 expref: 32 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706615:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea38215f800/0xd05e6ae1590e1ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1ff1 expref: 32 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706628:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215f800/0xd05e6ae1590e1ff8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1ff1 expref: 32 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706640:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349796.706672:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea35094a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+31:3649:x1869977659430528:12345-0@lo:103: Request processed in 81us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.706686:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783349796.706725:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349796.706732:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+30:3649:x1869977659431040:12345-0@lo:103: 00010000:00010000:2.0:1783349796.706740:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349796.706744:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f81 expref: 30 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706753:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f81 expref: 30 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706763:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea341524c00/0xd05e6ae1590e1f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1f81 expref: 30 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706774:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349796.706796:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+29:3649:x1869977659431040:12345-0@lo:103: Request processed in 65us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.706802:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349796.706814:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349796.706819:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+28:3649:x1869977659430400:12345-0@lo:103: 00010000:00010000:2.0:1783349796.706827:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349796.706831:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e2022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e201b expref: 28 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706839:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e2022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e201b expref: 28 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706847:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e2022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e201b expref: 28 pid: 6512 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706866:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349796.706888:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+27:3649:x1869977659430400:12345-0@lo:103: Request processed in 69us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.706895:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349796.706907:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349796.706913:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+26:3649:x1869977659430912:12345-0@lo:103: 00010000:00010000:2.0:1783349796.706919:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349796.706923:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e1f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f8f expref: 26 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706931:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e1f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f8f expref: 26 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706940:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e1f96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1f8f expref: 26 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.706948:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349796.706968:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+25:3649:x1869977659430912:12345-0@lo:103: Request processed in 56us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.706974:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349796.706985:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349796.706991:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659431424:12345-0@lo:103: 00010000:00010000:2.0:1783349796.706997:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349796.707002:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e1f11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f0a expref: 24 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707010:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e1f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f0a expref: 24 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707026:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e1f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1f0a expref: 24 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707034:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349796.707056:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:3649:x1869977659431424:12345-0@lo:103: Request processed in 66us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.707062:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349796.707074:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783349796.707079:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:3646:x1869977659430656:12345-0@lo:103: 00010000:00010000:2.0:1783349796.707086:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349796.707091:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e1fd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1fce expref: 22 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707098:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e1fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1fce expref: 22 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707107:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e1fd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1fce expref: 22 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707115:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349796.707166:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:3646:x1869977659430656:12345-0@lo:103: Request processed in 86us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.707172:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783349796.707184:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349796.707190:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:3646:x1869977659431168:12345-0@lo:103: 00010000:00010000:2.0:1783349796.707197:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349796.707201:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e1f7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f73 expref: 20 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707215:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e1f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f73 expref: 20 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707224:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e1f7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1f73 expref: 20 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707233:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349796.707256:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3646:x1869977659431168:12345-0@lo:103: Request processed in 66us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.707262:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349796.707274:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783349796.707280:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea35094b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3646:x1869977659430784:12345-0@lo:103: 00010000:00010000:2.0:1783349796.707287:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349796.707291:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1fb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1fab expref: 18 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707299:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1fab expref: 18 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707308:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e1fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1fab expref: 18 pid: 6511 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.707316:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349796.707336:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea35094b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:3646:x1869977659430784:12345-0@lo:103: Request processed in 57us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.707342:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783349796.707739:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783349796.707752:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3646:x1869977659431296:12345-0@lo:103: 00010000:00010000:3.0:1783349796.707763:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349796.707778:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e1f3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f34 expref: 16 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349796.707788:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e1f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f34 expref: 16 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349796.707799:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e1f3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1f34 expref: 16 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349796.707817:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349796.707848:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3646:x1869977659431296:12345-0@lo:103: Request processed in 100us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349796.707855:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783349796.708662:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659430784:0@lo:103: 00000100:00100000:2.0:1783349796.708677:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659431296:0@lo:103: 00000100:00100000:2.0:1783349796.708700:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659430656:0@lo:103: 00000100:00100000:2.0:1783349796.708710:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659431168:0@lo:103: 00000100:00100000:3.0:1783349796.708723:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659430400:0@lo:103: 00000100:00100000:3.0:1783349796.708738:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659430912:0@lo:103: 00000100:00100000:3.0:1783349796.708747:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659431424:0@lo:103: 00000100:00100000:3.0:1783349796.708754:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659430528:0@lo:103: 00000100:00100000:3.0:1783349796.708761:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659431040:0@lo:103: 00000100:00100000:0.0:1783349796.709056:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659428992:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349796.709067:0:10329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1869977659429120:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349796.709097:0:10329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349796.714588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349796.714727:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642603264 00000100:00100000:2.0:1783349796.714738:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642603264 00000100:00100000:2.0:1783349796.714928:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 197 00000100:00100000:2.0:1783349796.714939:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6167:x1869977642603264:12345-192.168.203.50@tcp:101: 00010000:00010000:2.0:1783349796.714958:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349796.714973:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e207d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decd91 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.714999:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.715009:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e207d lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd91 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.715183:0:6510:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.715200:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e207d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd91 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349796.715208:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cca00, rc 0) 00000100:00100000:2.0:1783349796.715413:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:6167:x1869977642603264:12345-192.168.203.50@tcp:101: Request processed in 474us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.715421:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 197 00000100:00100000:3.0:1783349796.716078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349796.716416:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642603136 00000100:00100000:0.0:1783349796.716424:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642603136 00010000:00010000:0.0:1783349796.716459:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2037 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd21 expref: 11 pid: 6512 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349796.716516:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:0.0:1783349796.716524:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:2400:x1869977642603136:12345-192.168.203.50@tcp:103: 00010000:00010000:0.0:1783349796.716538:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349796.716543:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2037 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd21 expref: 11 pid: 6512 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.716553:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd21 expref: 11 pid: 6512 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.716569:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2037 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd21 expref: 11 pid: 6512 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.716580:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349796.716628:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2400:x1869977642603136:12345-192.168.203.50@tcp:103: Request processed in 105us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349796.716634:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:3.0:1783349796.719024:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349796.719656:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642603392 00000100:00100000:1.0:1783349796.719667:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642603392 00010000:00010000:1.0:1783349796.719711:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e2030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd1a expref: 10 pid: 6510 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349796.719741:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:1.0:1783349796.719762:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2401:x1869977642603392:12345-192.168.203.50@tcp:103: 00010000:00010000:1.0:1783349796.719785:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349796.719791:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e2030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd1a expref: 10 pid: 6510 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719803:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e2030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd1a expref: 10 pid: 6510 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719821:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e2030 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd1a expref: 10 pid: 6510 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719837:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719844:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719860:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719866:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719871:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719877:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719882:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783349796.719886:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719899:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719916:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e207d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd91 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719922:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e207d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd91 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.719946:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e207d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd91 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349796.719958:0:6504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:6504:1869977659431552:192.168.203.50@tcp:105: 00000100:00100000:1.0:1783349796.720048:0:6504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2437b5cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1783349796.720840:0:10329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349796.720853:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349796.722964:0:6504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:6504:1869977659431552:192.168.203.50@tcp:105: 00010000:00010000:1.0:1783349796.722994:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.723006:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e2076 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.723016:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349796.723606:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:2401:x1869977642603392:12345-192.168.203.50@tcp:103: Request processed in 3838us (4593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349796.723618:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:2.0:1783349796.730983:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349796.733681:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642603520 00000100:00100000:0.0:1783349796.733695:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642603520 00000100:00100000:0.0:1783349796.733863:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 198 00000100:00100000:0.0:1783349796.733878:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6167:x1869977642603520:12345-192.168.203.50@tcp:501: 00000100:00100000:0.0:1783349796.734043:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6167:x1869977642603520:12345-192.168.203.50@tcp:501: Request processed in 168us (4490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349796.734059:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 198 00000100:00100000:0.0:1783349796.736961:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349796.737502:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642603648 00000100:00100000:2.0:1783349796.737515:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642603648 00000100:00100000:2.0:1783349796.737577:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 199 00000100:00100000:2.0:1783349796.737588:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6167:x1869977642603648:12345-192.168.203.50@tcp:503: 00000100:00100000:2.0:1783349796.737744:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6167:x1869977642603648:12345-192.168.203.50@tcp:503: Request processed in 157us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349796.737751:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 199 00000100:00100000:3.0:1783349796.743684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349796.744592:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642603776 00000100:00100000:0.0:1783349796.744606:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642603776 00000100:00100000:0.0:1783349796.744703:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 200 00000100:00100000:0.0:1783349796.744714:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6633:x1869977642603776:12345-192.168.203.50@tcp:502: 00000100:00100000:0.0:1783349796.744898:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6633:x1869977642603776:12345-192.168.203.50@tcp:502: Request processed in 185us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349796.744907:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 200 00000100:00100000:2.0:1783349796.749796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349796.750206:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642603904 00000100:00100000:0.0:1783349796.750217:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642603904 00000100:00100000:0.0:1783349796.750273:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 201 00000100:00100000:0.0:1783349796.750284:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6633:x1869977642603904:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783349796.750506:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6633:x1869977642603904:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 223us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349796.750515:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 201 00000100:00100000:3.0:1783349796.754402:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349796.754525:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642604032 00000100:00100000:1.0:1783349796.754535:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642604032 00000100:00100000:1.0:1783349796.754593:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 202 00000100:00100000:1.0:1783349796.754614:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6167:x1869977642604032:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349796.754636:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349796.754653:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e2084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decd98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.754680:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e2084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd98 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.754690:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e2084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd98 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349796.754699:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d000, rc 0) 00000100:00100000:1.0:1783349796.754889:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6167:x1869977642604032:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 275us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349796.754897:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 202 00000100:00100000:2.0:1783349796.784070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349796.784164:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642604160 00000100:00100000:1.0:1783349796.784176:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642604160 00000100:00100000:1.0:1783349796.784231:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 203 00000100:00100000:1.0:1783349796.784241:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6167:x1869977642604160:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349796.784369:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6167:x1869977642604160:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 128us (308us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783349796.784376:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 203 00000100:00100000:0.0:1783349797.253832:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783349797.253858:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659431680:0@lo:13: 00000100:00100000:0.0:1783349797.254038:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349797.255884:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659431680 00000100:00100000:1.0:1783349797.255899:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659431680 00000100:00080000:3.0:1783349797.255998:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349797.256102:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783349797.256103:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783349797.256119:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659431680:12345-0@lo:13: 00000100:00100000:2.0:1783349797.256123:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659431808:0@lo:13: 00002000:00000024:1.0:1783349797.256173:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349797.256208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349797.256385:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659431680:12345-0@lo:13: Request processed in 272us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349797.256405:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349797.256422:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659431808 00000100:00100000:1.0:1783349797.256425:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659431808 00000100:00100000:1.0:1783349797.256458:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349797.256464:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659431808:12345-0@lo:13: 00002000:00000024:1.0:1783349797.256473:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783349797.256489:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349797.256506:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659431808:12345-0@lo:13: Request processed in 40us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349797.256512:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1783349797.256546:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243200a80 x1869977659431808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349797.256563:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659431808:0@lo:13: 00010000:00080000:2.0:1783349797.256719:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370df6300 x1869977659431680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349797.256733:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659431680:0@lo:13: 00010000:00010000:3.0:1783349797.508739:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783349797.616191:0:10382:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd897f1d10 20000000:00000080:3.0:1783349797.616226:0:10382:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ea243844c00 uarg=0000000000000000 20000000:01000000:3.0:1783349797.616275:0:10382:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783349797.616282:0:10382:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783349797.616288:0:10382:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783349797.617334:0:10383:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1783349797.617958:0:10382:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1783349797.623869:0:10382:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1783349797.623901:0:10382:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1783349797.623914:0:10382:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1783349797.623929:0:10382:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783349797.623948:0:10382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.623981:0:10382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea341524200/0xd05e6ae1590e1da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1d9e expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.623988:0:10382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea38215ea00/0xd05e6ae1590e1db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1dac expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.623995:0:10382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e1e07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1e00 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.624001:0:10382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea341524a00/0xd05e6ae1590e1f2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e1f26 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.624009:0:10382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2045 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd59 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.624017:0:10382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.624058:0:10382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd59 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.624074:0:10382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2045 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd59 expref: 9 pid: 6510 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.624088:0:10382:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10382:1869977659431936:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349797.624341:0:10382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea341524a00/0xd05e6ae1590e1f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1f26 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.624360:0:10382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea341524a00/0xd05e6ae1590e1f2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f26 expref: 14 pid: 6510 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.624376:0:10382:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10382:1869977659432064:0@lo:104: 00000100:00100000:0.0:1783349797.624415:0:10382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349797.625326:0:10382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e1e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1e00 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.625337:0:10382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e1e07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e00 expref: 14 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.625357:0:10382:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10382:1869977659432192:0@lo:104: 00000100:00100000:0.0:1783349797.625389:0:10382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349797.628521:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349797.628558:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642604288 00000100:00100000:3.0:1783349797.628617:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642604288 00010000:00010000:3.0:1783349797.628657:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2045 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd59 expref: 10 pid: 6510 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349797.628689:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:3.0:1783349797.628697:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243721f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2400:x1869977642604288:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349797.628708:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349797.628709:0:10382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea38215ea00/0xd05e6ae1590e1db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1dac expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349797.628714:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2045 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd59 expref: 10 pid: 6510 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.628720:0:10382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea38215ea00/0xd05e6ae1590e1db3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1dac expref: 14 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349797.628733:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2045 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd59 expref: 10 pid: 6510 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.628733:0:10382:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10382:1869977659432320:0@lo:104: 00010000:00010000:3.0:1783349797.628750:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349797.628783:0:10382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea341524200/0xd05e6ae1590e1da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e1d9e expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349797.628788:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243721f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2400:x1869977642604288:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 91us (276us total) trans 0 rc 0/0 00010000:00010000:0.0:1783349797.628792:0:10382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea341524200/0xd05e6ae1590e1da5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d9e expref: 14 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349797.628797:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:0.0:1783349797.628799:0:10382:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10382:1869977659432448:0@lo:104: 00000100:00100000:0.0:1783349797.628816:0:10382:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77f00 going to sleep for 11 seconds 00010000:00010000:0.0:1783349797.628838:0:10382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2045 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd59 expref: 9 pid: 6510 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.628864:0:10382:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10382:1869977659431936:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349797.631406:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783349797.631451:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349797.631473:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349797.631483:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659432064 00000100:00100000:2.0:1783349797.631491:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659432064 00000100:00100000:2.0:1783349797.631532:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659432192 00000100:00100000:2.0:1783349797.631535:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659432192 00000100:00100000:2.0:1783349797.632281:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659432320 00000100:00100000:2.0:1783349797.632287:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659432320 00000100:00100000:2.0:1783349797.632307:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659432448 00000100:00100000:2.0:1783349797.632310:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659432448 00000100:00100000:2.0:1783349797.632322:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783349797.632330:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:10382:x1869977659432064:12345-0@lo:104: 00010000:00010000:2.0:1783349797.632369:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.632437:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783349797.632443:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:10382:x1869977659432064:12345-0@lo:104: Request processed in 115us (8029us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.632451:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783349797.632465:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783349797.632471:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243255c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:10382:x1869977659432192:12345-0@lo:104: 00010000:00010000:2.0:1783349797.632478:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.632503:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783349797.632508:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243255c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:10382:x1869977659432192:12345-0@lo:104: Request processed in 38us (7119us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.632513:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783349797.632659:0:10382:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10382:1869977659432064:0@lo:104: 00000100:00100000:0.0:1783349797.632669:0:10382:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10382:1869977659432192:0@lo:104: 00000100:00100000:2.0:1783349797.632844:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783349797.632851:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:10382:x1869977659432320:12345-0@lo:104: 00010000:00010000:2.0:1783349797.632860:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.632936:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783349797.632942:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:10382:x1869977659432320:12345-0@lo:104: Request processed in 92us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.632948:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783349797.632959:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783349797.632965:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:10382:x1869977659432448:12345-0@lo:104: 00010000:00010000:2.0:1783349797.632979:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e1d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633008:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783349797.633013:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:10382:x1869977659432448:12345-0@lo:104: Request processed in 49us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.633018:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1783349797.633035:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783349797.633040:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633047:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349797.633051:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633059:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349797.633066:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349797.633072:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349797.633105:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633112:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349797.633131:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633164:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e1f26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1f2d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633181:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783349797.633185:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633201:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525e00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349797.633205:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633212:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349797.633219:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349797.633225:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349797.633237:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633243:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349797.633255:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633261:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea341525e00/0xd05e6ae1590e1e00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1e07 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633271:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349797.633274:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633289:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3429f0000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349797.633292:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633298:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349797.633305:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349797.633310:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349797.633320:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633326:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349797.633330:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633337:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e1dac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1db3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633355:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349797.633359:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e1d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633365:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fa00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349797.633368:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e1d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633383:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e1d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349797.633390:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e1d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349797.633395:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349797.633406:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e1d9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633412:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349797.633416:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e1d9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633423:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e1d9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e1da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.633434:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349797.633436:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349797.633438:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349797.633444:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349797.633448:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349797.633464:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659432960:0@lo:103: 00000100:00100000:2.0:1783349797.633498:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349797.633528:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349797.633533:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659432576:0@lo:103: 00000100:00100000:2.0:1783349797.633629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349797.633641:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1783349797.633653:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659432704:0@lo:103: 00000100:00100000:1.0:1783349797.633659:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659432960 00000100:00100000:1.0:1783349797.633664:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659432960 00000100:00100000:2.0:1783349797.633685:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783349797.633687:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea341524200/0xd05e6ae1590e1da5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d9e expref: 15 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349797.633702:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349797.633702:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659432576 00000100:00100000:1.0:1783349797.633705:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659432576 00000100:00100000:2.0:1783349797.633707:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659432832:0@lo:103: 00010000:00010000:1.0:1783349797.633715:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea341524a00/0xd05e6ae1590e1f2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f26 expref: 16 pid: 6510 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349797.633726:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349797.633726:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659432704 00000100:00100000:1.0:1783349797.633728:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659432704 00010000:00010000:1.0:1783349797.633736:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e1e07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e00 expref: 17 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349797.633748:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659432832 00000100:00100000:2.0:1783349797.633750:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659432832 00000100:00100000:1.0:1783349797.633760:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1783349797.633762:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea38215ea00/0xd05e6ae1590e1db3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1dac expref: 18 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349797.633766:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3646:x1869977659432960:12345-0@lo:103: 00010000:00010000:1.0:1783349797.633778:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349797.633783:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea341524200/0xd05e6ae1590e1da5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d9e expref: 18 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.633791:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea341524200/0xd05e6ae1590e1da5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1d9e expref: 18 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.633808:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349797.633839:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:3646:x1869977659432960:12345-0@lo:103: Request processed in 73us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349797.633845:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783349797.633861:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783349797.633866:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:3646:x1869977659432576:12345-0@lo:103: 00010000:00010000:1.0:1783349797.633872:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349797.633877:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea341524a00/0xd05e6ae1590e1f2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f26 expref: 17 pid: 6510 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.633886:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea341524a00/0xd05e6ae1590e1f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1f26 expref: 17 pid: 6510 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.633896:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea341524a00/0xd05e6ae1590e1f2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1f26 expref: 17 pid: 6510 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.633906:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349797.633922:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783349797.633927:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3646:x1869977659432576:12345-0@lo:103: Request processed in 61us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.633928:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea35094a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:3648:x1869977659432704:12345-0@lo:103: 00010000:00010000:2.0:1783349797.633936:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349797.633940:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e1e07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e00 expref: 16 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349797.633941:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1783349797.633948:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e1e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1e00 expref: 15 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349797.633951:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783349797.633956:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:3648:x1869977659432832:12345-0@lo:103: 00010000:00010000:2.0:1783349797.633958:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e1e07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1e00 expref: 15 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.633963:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349797.633966:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349797.633991:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea35094a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:3648:x1869977659432704:12345-0@lo:103: Request processed in 63us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.633996:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349797.634046:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659432704:0@lo:103: 00010000:00010000:1.0:1783349797.634059:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea38215ea00/0xd05e6ae1590e1db3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e1dac expref: 13 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634067:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea38215ea00/0xd05e6ae1590e1db3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e1dac expref: 13 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634078:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634086:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634100:0:7459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634107:0:7459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634117:0:7459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634124:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634128:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ec00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783349797.634132:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634166:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634174:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.634184:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349797.634211:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:3648:x1869977659432832:12345-0@lo:103: Request processed in 254us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349797.634217:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783349797.634246:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659432576:0@lo:103: 00000100:00100000:1.0:1783349797.634254:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659432960:0@lo:103: 00000100:00100000:1.0:1783349797.634271:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659432832:0@lo:103: 00010000:00010000:0.0:1783349797.637745:0:10382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215ea00/0xd05e6ae1590e1db3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1dac expref: 12 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.637887:0:10382:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10382:1869977659432320:0@lo:104: 00010000:00010000:0.0:1783349797.637906:0:10382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea341524200/0xd05e6ae1590e1da5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e1d9e expref: 11 pid: 6511 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.637918:0:10382:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10382:1869977659432448:0@lo:104: 00010000:00010000:0.0:1783349797.637948:0:10382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.637959:0:10382:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.637965:0:10382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.637972:0:10382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e208b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349798.293768:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349798.295901:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642604416 00000100:00100000:0.0:1783349798.295917:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642604416 00000100:00100000:0.0:1783349798.295986:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 204 00000100:00100000:0.0:1783349798.295997:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:6167:x1869977642604416:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349798.296023:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349798.296042:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e2092 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decd9f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.296071:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e2092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd9f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.296086:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e2092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd9f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.296095:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ec00, rc 0) 00000100:00100000:0.0:1783349798.296178:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6167:x1869977642604416:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 183us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.296186:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 204 00000100:00100000:1.0:1783349798.302129:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349798.302969:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642604544 00000100:00100000:3.0:1783349798.302982:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642604544 00000100:00100000:3.0:1783349798.303046:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 205 00000100:00100000:3.0:1783349798.303056:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6167:x1869977642604544:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.303220:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6167:x1869977642604544:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 164us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.303229:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 205 00000100:00100000:3.0:1783349798.309822:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349798.310005:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642604672 00000100:00100000:2.0:1783349798.310016:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642604672 00000100:00100000:2.0:1783349798.310082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 206 00000100:00100000:2.0:1783349798.310110:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6167:x1869977642604672:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.310305:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6167:x1869977642604672:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 198us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.310313:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 206 00000100:00100000:3.0:1783349798.322798:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349798.322904:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642604800 00000100:00100000:1.0:1783349798.322916:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642604800 00000100:00100000:1.0:1783349798.322980:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 207 00000100:00100000:1.0:1783349798.322990:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6691:x1869977642604800:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349798.323213:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6691:x1869977642604800:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 223us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349798.323222:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 207 00000100:00100000:1.0:1783349798.329863:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349798.329945:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642604928 00000100:00100000:3.0:1783349798.329956:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642604928 00000100:00100000:3.0:1783349798.330012:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 208 00000100:00100000:3.0:1783349798.330022:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6691:x1869977642604928:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783349798.330252:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:6691:x1869977642604928:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 231us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.330262:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 208 10000000:01000000:2.0:1783349798.340427:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783349798.340436:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea36d976000 from 48 10000000:01000000:2.0:1783349798.340442:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783349798.340563:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.340576:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.340587:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.340610:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433088:0@lo:101: 00000100:00100000:2.0:1783349798.340676:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.340728:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.341517:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659433088 00000100:00100000:3.0:1783349798.341526:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659433088 00000100:00100000:3.0:1783349798.341587:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783349798.341596:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+11:6514:x1869977659433088:12345-0@lo:101: 00010000:00010000:3.0:1783349798.341612:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349798.341630:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e20a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2099 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.341655:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e20a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2099 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.341669:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e20a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2099 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.341681:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f1a00, rc 0) 00000100:00100000:3.0:1783349798.341750:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6514:x1869977659433088:12345-0@lo:101: Request processed in 155us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.341756:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1783349798.341790:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433088:0@lo:101: 00010000:00010000:2.0:1783349798.341805:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.341814:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.341881:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433216:0@lo:501: 00000100:00100000:2.0:1783349798.341909:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.341999:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.342590:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659433216 00000100:00100000:0.0:1783349798.342596:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659433216 00000100:00100000:0.0:1783349798.342635:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1783349798.342644:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6514:x1869977659433216:12345-0@lo:501: 00000100:00100000:0.0:1783349798.342788:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6514:x1869977659433216:12345-0@lo:501: Request processed in 145us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.342795:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783349798.343131:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433216:0@lo:501: 00000100:00100000:3.0:1783349798.343213:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433344:0@lo:503: 00000100:00100000:3.0:1783349798.343288:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.343324:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea344527d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.343422:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659433344 00000100:00100000:2.0:1783349798.343429:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659433344 00000100:00100000:2.0:1783349798.343469:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1783349798.343476:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6514:x1869977659433344:12345-0@lo:503: 00000100:00100000:2.0:1783349798.343579:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6514:x1869977659433344:12345-0@lo:503: Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.343586:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1783349798.343721:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433344:0@lo:503: 00000100:00100000:3.0:1783349798.344131:0:10402:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10402:1869977659433472:0@lo:502: 00000100:00100000:3.0:1783349798.344193:0:10402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.344243:0:10402:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea344527e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.345993:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659433472 00000100:00100000:2.0:1783349798.346004:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659433472 00000100:00100000:2.0:1783349798.346062:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1783349798.346073:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:10402:x1869977659433472:12345-0@lo:502: 00000100:00100000:2.0:1783349798.346274:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:10402:x1869977659433472:12345-0@lo:502: Request processed in 203us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.346282:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1783349798.346481:0:10402:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10402:1869977659433472:0@lo:502: 00000100:00100000:0.0:1783349798.346543:0:10402:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10402:1869977659433600:0@lo:502: 00000100:00100000:0.0:1783349798.346586:0:10402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.346617:0:10402:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.350096:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659433600 00000100:00100000:2.0:1783349798.350115:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659433600 00000100:00100000:1.0:1783349798.350277:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783349798.350295:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:10402:x1869977659433600:12345-0@lo:502: 00000100:00100000:1.0:1783349798.350495:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:10402:x1869977659433600:12345-0@lo:502: Request processed in 206us (3908us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349798.350503:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783349798.350680:0:10402:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10402:1869977659433600:0@lo:502: 00000040:00080000:3.0:1783349798.350717:0:10402:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783349798.350802:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783349798.350829:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349798.350844:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.350856:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349798.350866:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783349798.350868:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1783349798.350876:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783349798.350908:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.350923:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.350932:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.350953:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433728:0@lo:101: 00000100:00100000:2.0:1783349798.350991:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.351027:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.351199:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659433728 00000100:00100000:3.0:1783349798.351205:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659433728 00000100:00100000:3.0:1783349798.351243:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1783349798.351253:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+12:6514:x1869977659433728:12345-0@lo:101: 00010000:00010000:3.0:1783349798.351262:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349798.351287:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e20ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e20a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.351605:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e20ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e20a7 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.351619:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e20ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e20a7 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.351641:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f0e00, rc 0) 00000100:00100000:3.0:1783349798.351695:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:6514:x1869977659433728:12345-0@lo:101: Request processed in 444us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.351703:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1783349798.351742:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433728:0@lo:101: 00010000:00010000:2.0:1783349798.351757:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.351766:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.351822:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433856:0@lo:501: 00000100:00100000:3.0:1783349798.354526:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.354584:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.354782:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659433856 00000100:00100000:0.0:1783349798.354794:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659433856 00000100:00100000:0.0:1783349798.354869:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1783349798.354878:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:6514:x1869977659433856:12345-0@lo:501: 00000100:00100000:0.0:1783349798.355033:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:6514:x1869977659433856:12345-0@lo:501: Request processed in 155us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.355049:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783349798.355787:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433856:0@lo:501: 00000100:00100000:2.0:1783349798.355849:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433984:0@lo:503: 00000100:00100000:2.0:1783349798.355900:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.355944:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.356026:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659433984 00000100:00100000:3.0:1783349798.356033:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659433984 00000100:00100000:3.0:1783349798.356105:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783349798.356116:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:6514:x1869977659433984:12345-0@lo:503: 00000100:00100000:3.0:1783349798.356247:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:6514:x1869977659433984:12345-0@lo:503: Request processed in 132us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.356251:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659433984:0@lo:503: 00000100:00100000:3.0:1783349798.356259:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783349798.356808:0:10403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10403:1869977659434112:0@lo:502: 00000100:00100000:3.0:1783349798.356861:0:10403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.356888:0:10403:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3445276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.357438:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659434112 00000100:00100000:2.0:1783349798.357447:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659434112 00000100:00100000:2.0:1783349798.357486:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783349798.357503:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:10403:x1869977659434112:12345-0@lo:502: 00000100:00100000:2.0:1783349798.357609:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:10403:x1869977659434112:12345-0@lo:502: Request processed in 106us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.357616:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783349798.357715:0:10403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10403:1869977659434112:0@lo:502: 00000020:01000000:3.0:1783349798.357742:0:10403:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349798.357751:0:10403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349798.357753:0:10403:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783349798.357758:0:10403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783349798.357786:0:10403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10403:1869977659434240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.357829:0:10403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.357855:0:10403:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea35931a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.357896:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659434240 00000100:00100000:2.0:1783349798.357900:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659434240 00000100:00100000:2.0:1783349798.357930:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783349798.357936:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:10403:x1869977659434240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.357996:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:10403:x1869977659434240:12345-0@lo:502:llog_process_th.0 Request processed in 59us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.358003:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1783349798.358228:0:10403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10403:1869977659434240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783349798.358252:0:10403:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349798.358257:0:10403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349798.358259:0:10403:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783349798.358262:0:10403:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1783349798.358425:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1783349798.358448:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783349798.358457:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.358467:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349798.358478:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783349798.358481:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d976000 from 4 10000000:01000000:2.0:1783349798.358483:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783349798.358512:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.358520:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.358528:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.358550:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659434368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.358582:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.358611:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4840 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.358657:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659434368 00000100:00100000:3.0:1783349798.358661:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659434368 00000100:00100000:3.0:1783349798.358692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783349798.358700:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+13:6514:x1869977659434368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349798.358710:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349798.358722:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e20bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e20b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.358741:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e20bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e20b5 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.358750:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e20bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e20b5 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.358759:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f1200, rc 0) 00000100:00100000:3.0:1783349798.358787:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659434368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.358793:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1783349798.359113:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659434368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349798.359126:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.359326:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349798.360377:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659434496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.360445:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.360520:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.360623:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659434496 00000100:00100000:2.0:1783349798.360630:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659434496 00000100:00100000:2.0:1783349798.360673:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783349798.360681:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659434496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.360826:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659434496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.360833:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1783349798.360911:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659434496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349798.360943:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659434624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349798.360988:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349798.361041:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2437b5600 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.368487:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659434624 00000100:00100000:2.0:1783349798.368500:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659434624 00000100:00100000:2.0:1783349798.368567:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1783349798.368577:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659434624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.368722:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659434624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (7733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.368729:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1783349798.370364:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659434624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349798.371481:0:10404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10404:1869977659434752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349798.371558:0:10404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349798.373526:0:10404:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2437b5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.373958:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659434752 00000100:00100000:0.0:1783349798.373969:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659434752 00000100:00100000:0.0:1783349798.374079:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783349798.374091:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:10404:x1869977659434752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.374274:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:10404:x1869977659434752:12345-0@lo:502:llog_process_th.0 Request processed in 185us (2715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349798.374916:0:10404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10404:1869977659434752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783349798.375062:0:10404:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349798.375074:0:10404:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349798.375077:0:10404:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783349798.375083:0:10404:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea36d976000 00000020:00000080:1.0:1783349798.375086:0:10404:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783349798.375668:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783349798.376487:0:10404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10404:1869977659434880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.376559:0:10404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.376602:0:10404:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.376669:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659434880 00000100:00100000:2.0:1783349798.376683:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659434880 00000100:00100000:2.0:1783349798.376808:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1783349798.376817:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:10404:x1869977659434880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.377035:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:10404:x1869977659434880:12345-0@lo:502:llog_process_th.0 Request processed in 219us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.377043:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783349798.377115:0:10404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10404:1869977659434880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349798.377158:0:10404:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349798.377165:0:10404:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349798.377167:0:10404:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783349798.377171:0:10404:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783349798.377522:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783349798.377544:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783349798.377553:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.377564:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349798.377574:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783349798.377576:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea36d918000 from 48 10000000:01000000:2.0:1783349798.377579:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783349798.377606:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.377615:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.377623:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.377640:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.377675:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.377858:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.377903:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659435008 00000100:00100000:3.0:1783349798.377909:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659435008 00000100:00100000:3.0:1783349798.378049:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783349798.378058:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+14:6514:x1869977659435008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349798.378068:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349798.378080:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3429f0800/0xd05e6ae1590e20ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e20c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.378110:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3429f0800/0xd05e6ae1590e20ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e20c3 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.378119:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3429f0800/0xd05e6ae1590e20ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e20c3 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.378127:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f0800, rc 0) 00000100:00100000:3.0:1783349798.378189:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659435008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.378195:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783349798.378276:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349798.378289:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.378306:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349798.378367:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.378406:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.378820:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659435136 00000100:00100000:2.0:1783349798.378825:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659435136 00000100:00100000:2.0:1783349798.378849:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783349798.378855:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659435136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.378964:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659435136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.378970:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783349798.379501:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.379519:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.379556:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.379599:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.379621:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.379775:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659435264 00000100:00100000:2.0:1783349798.379781:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659435264 00000100:00100000:2.0:1783349798.381901:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1783349798.385880:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659435264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.386127:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659435264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (6527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.386149:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1783349798.386320:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.389307:0:10407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10407:1869977659435392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.389480:0:10407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.389517:0:10407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77300 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.390376:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659435392 00000100:00100000:3.0:1783349798.390388:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659435392 00000100:00100000:3.0:1783349798.390439:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783349798.390450:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:10407:x1869977659435392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.390605:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:10407:x1869977659435392:12345-0@lo:502:llog_process_th.0 Request processed in 158us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.390614:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1783349798.391186:0:10407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10407:1869977659435392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.391619:0:10407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10407:1869977659435520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.391667:0:10407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.391740:0:10407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77300 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.391773:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659435520 00000100:00100000:3.0:1783349798.391779:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659435520 00000100:00100000:3.0:1783349798.391848:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1783349798.391857:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:10407:x1869977659435520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.392013:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:10407:x1869977659435520:12345-0@lo:502:llog_process_th.0 Request processed in 158us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.394975:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1783349798.395847:0:10407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10407:1869977659435520:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783349798.395894:0:10407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783349798.402738:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783349798.402779:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349798.402791:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.402804:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349798.402814:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783349798.402817:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1783349798.402820:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783349798.402857:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.402877:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.402889:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.402916:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.403652:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.403688:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4900 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.403707:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659435648 00000100:00100000:2.0:1783349798.403714:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659435648 00000100:00100000:2.0:1783349798.403754:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1783349798.403762:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+15:6514:x1869977659435648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349798.403778:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349798.403793:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e20d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e20d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.403815:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e20d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e20d1 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.403825:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e20d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e20d1 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.403834:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd400, rc 0) 00000100:00100000:2.0:1783349798.403866:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659435648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.403873:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1783349798.403913:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349798.406425:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.406443:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.406535:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.406593:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.406624:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4900 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.406643:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659435776 00000100:00100000:2.0:1783349798.406650:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659435776 00000100:00100000:2.0:1783349798.406689:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783349798.406699:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659435776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.406818:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659435776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.406826:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783349798.406865:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.406891:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.407887:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.407908:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4900 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.407921:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659435904 00000100:00100000:2.0:1783349798.407936:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659435904 00000100:00100000:2.0:1783349798.407963:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1783349798.407969:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659435904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.408055:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659435904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.408068:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1783349798.408112:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659435904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.408668:0:10408:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10408:1869977659436032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.408708:0:10408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.408729:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659436032 00000100:00100000:2.0:1783349798.408733:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659436032 00000100:00100000:2.0:1783349798.408753:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1783349798.408759:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:10408:x1869977659436032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.408835:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:10408:x1869977659436032:12345-0@lo:502:llog_process_th.0 Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.408842:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1783349798.408870:0:10408:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.408970:0:10408:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10408:1869977659436032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349798.408992:0:10408:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349798.409000:0:10408:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349798.409002:0:10408:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783349798.409007:0:10408:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783349798.409026:0:10408:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10408:1869977659436160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.409058:0:10408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.409077:0:10408:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.409453:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659436160 00000100:00100000:3.0:1783349798.409458:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659436160 00000100:00100000:3.0:1783349798.409492:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783349798.409498:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:10408:x1869977659436160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.409580:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:10408:x1869977659436160:12345-0@lo:502:llog_process_th.0 Request processed in 81us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.409586:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1783349798.409669:0:10408:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10408:1869977659436160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349798.409688:0:10408:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349798.409693:0:10408:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349798.409694:0:10408:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783349798.409697:0:10408:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1783349798.409841:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1783349798.409860:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783349798.409868:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.409877:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349798.409886:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783349798.409889:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d918000 from 4 10000000:01000000:3.0:1783349798.409892:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349798.409915:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.409933:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.409942:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349798.409958:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659436288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.409985:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.410013:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea35931a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.410110:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659436288 00000100:00100000:2.0:1783349798.410115:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659436288 00000100:00100000:2.0:1783349798.410170:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1783349798.410178:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+16:6514:x1869977659436288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349798.410186:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349798.410197:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e20e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e20df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.410371:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e20e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e20df expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.410382:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e20e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e20df expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.410391:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd800, rc 0) 00000100:00100000:2.0:1783349798.410424:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659436288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.410430:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1783349798.410869:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659436288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349798.410883:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.410893:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.411025:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659436416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.411056:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.411115:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.411541:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659436416 00000100:00100000:3.0:1783349798.411555:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659436416 00000100:00100000:3.0:1783349798.411602:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783349798.411609:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659436416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.411708:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659436416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.411715:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783349798.411832:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659436416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.411863:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659436544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.411898:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.412053:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659436544 00000100:00100000:3.0:1783349798.412057:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659436544 00000100:00100000:3.0:1783349798.412083:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783349798.412089:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659436544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.412182:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659436544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.412190:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783349798.412364:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.412378:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659436544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.414561:0:10409:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10409:1869977659436672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.414649:0:10409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.414692:0:10409:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea344527d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.414895:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659436672 00000100:00100000:2.0:1783349798.414906:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659436672 00000100:00100000:2.0:1783349798.415055:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783349798.415065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:10409:x1869977659436672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.415210:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:10409:x1869977659436672:12345-0@lo:502:llog_process_th.0 Request processed in 145us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.415459:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783349798.416544:0:10409:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10409:1869977659436672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349798.416588:0:10409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349798.416600:0:10409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349798.416602:0:10409:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783349798.416608:0:10409:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea36d918000 00000020:00000080:2.0:1783349798.416611:0:10409:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783349798.416692:0:10409:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10409:1869977659436800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.416747:0:10409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.416783:0:10409:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.416870:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659436800 00000100:00100000:3.0:1783349798.416876:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659436800 00000100:00100000:3.0:1783349798.416915:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783349798.417037:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:10409:x1869977659436800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.417124:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:10409:x1869977659436800:12345-0@lo:502:llog_process_th.0 Request processed in 89us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.417131:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1783349798.418110:0:10409:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10409:1869977659436800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349798.418179:0:10409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349798.418187:0:10409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349798.418190:0:10409:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783349798.418200:0:10409:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783349798.420538:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783349798.420571:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349798.420750:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.420763:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349798.420842:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783349798.420845:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea357ed9800 from 48 10000000:01000000:0.0:1783349798.420848:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783349798.420880:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.420888:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.420899:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349798.421020:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659436928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.421084:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.421180:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77180 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.421459:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659436928 00000100:00100000:2.0:1783349798.421467:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659436928 00000100:00100000:2.0:1783349798.421550:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1783349798.421559:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+17:6514:x1869977659436928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349798.421584:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349798.421597:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cde00/0xd05e6ae1590e20f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e20ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.421619:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cde00/0xd05e6ae1590e20f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e20ed expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.421630:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cde00/0xd05e6ae1590e20f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e20ed expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.421639:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cde00, rc 0) 00000100:00100000:2.0:1783349798.421682:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659436928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.421689:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1783349798.421725:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659436928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349798.421739:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.421748:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.421819:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659437056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.421846:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.422173:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea375e26900 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.422379:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659437056 00000100:00100000:0.0:1783349798.422384:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659437056 00000100:00100000:0.0:1783349798.422409:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783349798.422415:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659437056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.422526:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659437056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.422533:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1783349798.422651:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659437056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349798.422689:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659437184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349798.422730:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349798.422756:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2437b5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.422815:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659437184 00000100:00100000:0.0:1783349798.422819:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659437184 00000100:00100000:0.0:1783349798.422849:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783349798.422857:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659437184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.422932:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659437184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.422944:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783349798.422984:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659437184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349798.423387:0:10412:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10412:1869977659437312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349798.423426:0:10412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349798.423456:0:10412:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2437b5840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.423495:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659437312 00000100:00100000:0.0:1783349798.423500:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659437312 00000100:00100000:0.0:1783349798.423533:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783349798.423545:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:10412:x1869977659437312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.423812:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:10412:x1869977659437312:12345-0@lo:502:llog_process_th.0 Request processed in 272us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.423820:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783349798.423888:0:10412:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10412:1869977659437312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349798.423925:0:10412:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10412:1869977659437440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349798.423957:0:10412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349798.423975:0:10412:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2437b5840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.424015:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659437440 00000100:00100000:0.0:1783349798.424019:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659437440 00000100:00100000:0.0:1783349798.424071:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783349798.424079:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:10412:x1869977659437440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.424174:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:10412:x1869977659437440:12345-0@lo:502:llog_process_th.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.424180:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1783349798.424509:0:10412:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10412:1869977659437440:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783349798.424531:0:10412:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783349798.424733:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1783349798.424755:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783349798.424764:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.424775:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349798.424785:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783349798.424787:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1783349798.424852:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783349798.424880:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.424888:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.424897:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349798.424912:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659437568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.424946:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.425066:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342bc56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349798.425111:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659437568 00000100:00100000:1.0:1783349798.425118:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659437568 00000100:00100000:1.0:1783349798.425261:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1783349798.425270:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+18:6514:x1869977659437568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349798.425281:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349798.425294:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8c200/0xd05e6ae1590e2102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e20fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.425315:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8c200/0xd05e6ae1590e2102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e20fb expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.425325:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8c200/0xd05e6ae1590e2102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e20fb expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.425333:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c200, rc 0) 00000100:00100000:1.0:1783349798.425376:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659437568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349798.425382:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1783349798.425442:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659437568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349798.425455:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.425462:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349798.425512:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659437696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.425538:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.425554:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342bc56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.425575:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659437696 00000100:00100000:0.0:1783349798.425578:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659437696 00000100:00100000:0.0:1783349798.425599:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783349798.425604:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659437696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.425709:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659437696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.425721:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783349798.425751:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659437696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.425780:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659437824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.425828:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.425841:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.425852:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659437824 00000100:00100000:0.0:1783349798.425855:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659437824 00000100:00100000:0.0:1783349798.425877:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783349798.425883:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659437824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.425961:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659437824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.425967:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783349798.426024:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659437824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.426208:0:10413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10413:1869977659437952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.426242:0:10413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.426260:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659437952 00000100:00100000:0.0:1783349798.426264:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659437952 00000100:00100000:0.0:1783349798.426287:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783349798.426293:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:10413:x1869977659437952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.426381:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:10413:x1869977659437952:12345-0@lo:502:llog_process_th.0 Request processed in 87us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.426388:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783349798.426418:0:10413:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343227840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.426433:0:10413:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10413:1869977659437952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349798.426458:0:10413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349798.426466:0:10413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349798.426468:0:10413:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783349798.426473:0:10413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783349798.426495:0:10413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10413:1869977659438080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.426525:0:10413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.426604:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659438080 00000100:00100000:0.0:1783349798.426608:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659438080 00000100:00100000:0.0:1783349798.426630:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1783349798.426635:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:10413:x1869977659438080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.426690:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:10413:x1869977659438080:12345-0@lo:502:llog_process_th.0 Request processed in 54us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.426696:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1783349798.426720:0:10413:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.426730:0:10413:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10413:1869977659438080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349798.426745:0:10413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349798.426749:0:10413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349798.426750:0:10413:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783349798.426754:0:10413:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1783349798.426798:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1783349798.426813:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783349798.426821:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.426830:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349798.426840:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349798.426847:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea357ed9800 from 4 10000000:01000000:0.0:1783349798.426850:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349798.426871:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.426878:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.426885:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349798.426897:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659438208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.426920:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.426933:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.426944:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659438208 00000100:00100000:0.0:1783349798.426947:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659438208 00000100:00100000:0.0:1783349798.426967:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1783349798.426973:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:6514:x1869977659438208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349798.426980:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349798.426990:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e2110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2109 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.427008:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e2110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2109 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.427018:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e2110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2109 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.427026:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e200, rc 0) 00000100:00100000:0.0:1783349798.427049:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659438208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.427059:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1783349798.427091:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659438208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349798.427102:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.427110:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349798.427172:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659438336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.427194:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.427206:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.427218:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659438336 00000100:00100000:0.0:1783349798.427222:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659438336 00000100:00100000:0.0:1783349798.427242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1783349798.427247:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659438336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.427325:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659438336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.427331:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1783349798.427371:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659438336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.427393:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659438464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.427423:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.427436:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.427446:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659438464 00000100:00100000:0.0:1783349798.427450:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659438464 00000100:00100000:0.0:1783349798.427467:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783349798.427478:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659438464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.427542:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659438464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.427549:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783349798.427585:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659438464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.428740:0:10414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10414:1869977659438592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.428871:0:10414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.428908:0:10414:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.429221:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659438592 00000100:00100000:0.0:1783349798.429229:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659438592 00000100:00100000:0.0:1783349798.429274:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783349798.429283:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:10414:x1869977659438592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.429404:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:10414:x1869977659438592:12345-0@lo:502:llog_process_th.0 Request processed in 120us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.429411:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1783349798.429653:0:10414:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10414:1869977659438592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783349798.429682:0:10414:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349798.429691:0:10414:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349798.429693:0:10414:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783349798.429700:0:10414:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea357ed9800 00000020:00000080:3.0:1783349798.429702:0:10414:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783349798.429777:0:10414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10414:1869977659438720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.430041:0:10414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.430072:0:10414:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.430119:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659438720 00000100:00100000:2.0:1783349798.430124:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659438720 00000100:00100000:2.0:1783349798.430669:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1783349798.430678:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:10414:x1869977659438720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.430772:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:10414:x1869977659438720:12345-0@lo:502:llog_process_th.0 Request processed in 96us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.430779:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783349798.430891:0:10414:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10414:1869977659438720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783349798.430914:0:10414:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349798.430919:0:10414:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349798.430921:0:10414:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783349798.430924:0:10414:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783349798.431268:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783349798.431290:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349798.431300:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.431311:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349798.431321:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783349798.431323:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea3461c1000 from 48 10000000:01000000:0.0:1783349798.431326:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783349798.431363:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.431373:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.431392:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349798.431409:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659438848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.431442:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.431472:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf180 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.431681:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659438848 00000100:00100000:2.0:1783349798.431686:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659438848 00000100:00100000:2.0:1783349798.431720:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1783349798.431727:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659438848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349798.431737:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349798.431748:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582ccc00/0xd05e6ae1590e211e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2117 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.431769:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582ccc00/0xd05e6ae1590e211e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2117 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.431781:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582ccc00/0xd05e6ae1590e211e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2117 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.431789:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582ccc00, rc 0) 00000100:00100000:2.0:1783349798.431899:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659438848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.431906:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783349798.431967:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659438848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349798.432060:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.432070:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349798.432120:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659438976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.432309:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.432369:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.432400:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659438976 00000100:00100000:2.0:1783349798.432404:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659438976 00000100:00100000:2.0:1783349798.432461:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783349798.432473:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659438976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.432587:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659438976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.432595:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1783349798.432647:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659438976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.432674:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659439104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.432716:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.432932:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.432981:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659439104 00000100:00100000:0.0:1783349798.432986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659439104 00000100:00100000:0.0:1783349798.433008:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783349798.433014:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659439104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.433092:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659439104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.433099:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783349798.433401:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659439104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.433734:0:10415:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10415:1869977659439232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.433778:0:10415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.433897:0:10415:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.433929:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659439232 00000100:00100000:0.0:1783349798.433934:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659439232 00000100:00100000:0.0:1783349798.434067:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783349798.434076:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:10415:x1869977659439232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.434196:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:10415:x1869977659439232:12345-0@lo:502:llog_process_th.0 Request processed in 122us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.434203:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783349798.434329:0:10415:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10415:1869977659439232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.434375:0:10415:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10415:1869977659439360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.434434:0:10415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.434691:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659439360 00000100:00100000:2.0:1783349798.434695:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659439360 00000100:00100000:2.0:1783349798.434717:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783349798.434724:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:10415:x1869977659439360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.434827:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:10415:x1869977659439360:12345-0@lo:502:llog_process_th.0 Request processed in 102us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.434833:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783349798.434966:0:10415:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09240 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.434982:0:10415:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10415:1869977659439360:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783349798.435056:0:10415:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783349798.436919:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783349798.436951:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349798.436962:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.437334:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349798.437477:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783349798.437481:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1783349798.437484:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783349798.437521:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.437530:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.437540:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349798.437633:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659439488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.437694:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.437775:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.437872:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659439488 00000100:00100000:2.0:1783349798.437879:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659439488 00000100:00100000:2.0:1783349798.437956:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783349798.437965:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659439488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349798.437978:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349798.437995:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e212c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2125 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.438016:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e212c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2125 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.438026:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e212c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2125 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.438035:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc600, rc 0) 00000100:00100000:2.0:1783349798.438078:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659439488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.438085:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783349798.438173:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659439488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349798.438186:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.438201:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349798.438267:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659439616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.438292:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.438684:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.438716:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659439616 00000100:00100000:0.0:1783349798.438721:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659439616 00000100:00100000:0.0:1783349798.438744:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783349798.438751:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659439616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.438871:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659439616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.438884:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783349798.439050:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659439616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.439079:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659439744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.439117:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.439360:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659439744 00000100:00100000:0.0:1783349798.439365:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659439744 00000100:00100000:3.0:1783349798.439505:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.439541:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1783349798.439548:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659439744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.439702:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659439744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.439709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783349798.439771:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659439744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.440483:0:10416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10416:1869977659439872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.440522:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.441436:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659439872 00000100:00100000:0.0:1783349798.441445:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659439872 00000100:00100000:0.0:1783349798.441649:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783349798.441661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:10416:x1869977659439872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.441923:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:10416:x1869977659439872:12345-0@lo:502:llog_process_th.0 Request processed in 264us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.441931:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783349798.442376:0:10416:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.442400:0:10416:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10416:1869977659439872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349798.442437:0:10416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349798.442446:0:10416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349798.442448:0:10416:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783349798.442454:0:10416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783349798.442642:0:10416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10416:1869977659440000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349798.442687:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349798.442836:0:10416:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36d09e840 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.442882:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659440000 00000100:00100000:2.0:1783349798.442888:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659440000 00000100:00100000:2.0:1783349798.442931:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783349798.442939:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:10416:x1869977659440000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349798.443029:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:10416:x1869977659440000:12345-0@lo:502:llog_process_th.0 Request processed in 90us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.443035:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783349798.443355:0:10416:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10416:1869977659440000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783349798.443379:0:10416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349798.443385:0:10416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349798.443386:0:10416:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783349798.443391:0:10416:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1783349798.443480:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1783349798.443502:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783349798.443512:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.443524:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349798.443534:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783349798.443543:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea3461c1000 from 4 10000000:01000000:2.0:1783349798.443546:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783349798.443879:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.443889:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349798.443898:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349798.443915:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659440128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.443949:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349798.443977:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242784180 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.444096:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659440128 00000100:00100000:0.0:1783349798.444103:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659440128 00000100:00100000:0.0:1783349798.444161:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783349798.444169:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659440128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349798.444181:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349798.444449:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e213a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2133 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.444544:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e213a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2133 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.444557:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e213a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2133 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.444566:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f800, rc 0) 00000100:00100000:0.0:1783349798.444683:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659440128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 514us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.444691:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783349798.444865:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659440128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349798.444878:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.444887:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349798.444948:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659440256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349798.444981:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349798.445002:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2437b5300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349798.445361:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659440256 00000100:00100000:0.0:1783349798.445367:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659440256 00000100:00100000:0.0:1783349798.445394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1783349798.445401:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659440256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349798.446388:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659440256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 983us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.446399:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783349798.446726:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659440256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.446770:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659440384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.446885:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.446957:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.447003:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659440384 00000100:00100000:2.0:1783349798.447008:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659440384 00000100:00100000:2.0:1783349798.447078:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783349798.447087:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659440384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.447345:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659440384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349798.447353:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783349798.447695:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659440384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349798.449472:0:10417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10417:1869977659440512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349798.449542:0:10417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349798.449586:0:10417:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2437b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349798.450310:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659440512 00000100:00100000:1.0:1783349798.450318:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659440512 00000100:00100000:1.0:1783349798.450372:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783349798.450381:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:10417:x1869977659440512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349798.450501:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:10417:x1869977659440512:12345-0@lo:502:llog_process_th.0 Request processed in 120us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349798.450509:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783349798.450678:0:10417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10417:1869977659440512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783349798.450717:0:10417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349798.450725:0:10417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349798.450728:0:10417:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783349798.450734:0:10417:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea3461c1000 00000020:00000080:1.0:1783349798.450736:0:10417:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783349798.450874:0:10417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10417:1869977659440640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349798.450912:0:10417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349798.450936:0:10417:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2437b59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.451084:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659440640 00000100:00100000:3.0:1783349798.451090:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659440640 00000100:00100000:3.0:1783349798.451115:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783349798.451122:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:10417:x1869977659440640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349798.451375:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:10417:x1869977659440640:12345-0@lo:502:llog_process_th.0 Request processed in 252us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.451382:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783349798.451941:0:10417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:10417:1869977659440640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783349798.451967:0:10417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349798.451974:0:10417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349798.451976:0:10417:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783349798.451980:0:10417:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783349798.452172:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783349798.452191:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783349798.452202:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.452636:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349798.452647:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783349798.452649:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ea349f8b380 from 1 10000000:01000000:3.0:1783349798.452652:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783349798.452682:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea38215ea00/0xd05e6ae1590e2141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.452690:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea38215ea00/0xd05e6ae1590e2141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.452700:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea38215ea00/0xd05e6ae1590e2141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349798.452719:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659440768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.452765:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.452793:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09840 going to sleep for 11 seconds 00000100:00100000:3.0:1783349798.453962:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659440768 00000100:00100000:3.0:1783349798.453973:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659440768 00000100:00100000:3.0:1783349798.454019:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1783349798.454036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659440768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349798.454051:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349798.454065:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2141 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.454091:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2141 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.454101:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2141 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.454110:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea38215fc00, rc 0) 00000100:00100000:1.0:1783349798.455662:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659440768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349798.455688:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea38215ea00/0xd05e6ae1590e2141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2148 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.455699:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea38215ea00/0xd05e6ae1590e2141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e2148 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349798.455780:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659440896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349798.455898:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659440768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1862us (3130us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.455908:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1783349798.457784:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349798.457933:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2437b59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349798.460922:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659440896 00000100:00100000:2.0:1783349798.460940:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659440896 00000100:00100000:2.0:1783349798.461007:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1783349798.461017:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659440896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349798.461662:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659440896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 645us (3883us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783349798.461671:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1783349798.465785:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659440896:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783349798.465901:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783349798.465917:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea38215ea00/0xd05e6ae1590e2141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2148 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.465937:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea38215ea00/0xd05e6ae1590e2141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2148 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349798.533243:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349799.301661:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659441024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349799.301730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349799.301805:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659441024 00000100:00100000:1.0:1783349799.301812:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659441024 00000100:00100000:1.0:1783349799.301855:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783349799.301864:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659441024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783349799.301900:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783349799.301960:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659441024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349799.301967:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783349799.302011:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659441024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349799.509957:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349799.510001:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349799.510046:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349799.510078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349799.510096:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642605440 00000100:00100000:1.0:1783349799.510109:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642605440 00000100:00100000:0.0:1783349799.510110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349799.510188:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642605184 00000100:00100000:0.0:1783349799.510194:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642605184 00000100:00100000:1.0:1783349799.510206:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642605568 00000100:00100000:1.0:1783349799.510211:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642605568 00000100:00100000:0.0:1783349799.510230:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642605312 00000100:00100000:0.0:1783349799.510235:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642605312 00000100:00100000:0.0:1783349799.510269:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:0.0:1783349799.510280:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642605184:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349799.510322:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:1.0:1783349799.510344:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642605440:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349799.510380:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642605184:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 99us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349799.510386:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642605440:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 53us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349799.510393:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642605056 00000100:00100000:0.0:1783349799.510393:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:1.0:1783349799.510398:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:2.0:1783349799.510405:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642605056 00000100:00100000:0.0:1783349799.510419:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:1.0:1783349799.510422:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1783349799.510436:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642605312:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349799.510437:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642605568:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349799.510470:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642605312:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.510477:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:1.0:1783349799.510484:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642605568:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 51us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349799.510491:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:1.0:1783349799.510652:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 271 00000100:00100000:1.0:1783349799.510662:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2399:x1869977642605056:12345-192.168.203.50@tcp:400:kworker.0 00000100:00080000:3.0:1783349799.510674:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349799.510681:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349799.510684:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783349799.510687:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349799.510706:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2399:x1869977642605056:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 46us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349799.510713:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 271 00010000:00010000:1.0:1783349799.561233:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349800.580943:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349800.836480:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659441152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783349800.836575:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349800.836734:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659441152 00000100:00100000:1.0:1783349800.836744:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659441152 00000100:00100000:1.0:1783349800.836794:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783349800.836802:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659441152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783349800.836838:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783349800.836878:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659441152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.836885:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783349800.836927:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659441152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349800.837880:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659441280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349800.837936:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349800.839636:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659441792:0@lo:400:kworker.0 00000100:00100000:0.0:1783349800.839704:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349800.839729:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659442304:0@lo:400:kworker.0 00000100:00100000:0.0:1783349800.839753:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349800.839791:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783349800.839796:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659441664:0@lo:400:kworker.0 00000100:00100000:0.0:1783349800.839846:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349800.839867:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659442176:0@lo:400:kworker.0 00000100:00100000:0.0:1783349800.839889:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349800.839912:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659442688:0@lo:400:kworker.0 00000100:00100000:3.0:1783349800.839928:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659441536:0@lo:400:kworker.0 00000100:00100000:0.0:1783349800.839936:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349800.839972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349800.839984:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659441792 00000100:00100000:0.0:1783349800.839992:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659441792 00000100:00100000:3.0:1783349800.839997:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659442048:0@lo:400:kworker.0 00000100:00100000:3.0:1783349800.840020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349800.840062:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659441408:0@lo:400:kworker.0 00000100:00100000:2.0:1783349800.840105:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349800.840161:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659441920:0@lo:400:kworker.0 00000100:00100000:2.0:1783349800.840184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349800.840219:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659442560:0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.843907:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659441280 00000100:00100000:1.0:1783349800.843920:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659441280 00000100:00100000:1.0:1783349800.843988:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783349800.844006:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659441280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783349800.844041:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349800.844426:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659441280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 427us (6489us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.844435:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783349800.844460:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659442304 00000100:00100000:1.0:1783349800.844463:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659442304 00000100:00100000:1.0:1783349800.844491:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659442176 00000100:00100000:1.0:1783349800.844494:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659442176 00000100:00100000:1.0:1783349800.844504:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659442688 00000100:00100000:1.0:1783349800.844507:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659442688 00000100:00100000:1.0:1783349800.844517:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783349800.844522:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659442304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.846280:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659442304:12345-0@lo:400:kworker.0 Request processed in 1746us (6515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.846295:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783349800.846752:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783349800.846769:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659442176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.846832:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659442176:12345-0@lo:400:kworker.0 Request processed in 72us (6942us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.846838:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783349800.846849:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349800.846857:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659442688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.846882:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659442688:12345-0@lo:400:kworker.0 Request processed in 27us (6949us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.846887:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349800.847433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659441536 00000100:00100000:1.0:1783349800.847443:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659441536 00000100:00100000:1.0:1783349800.847476:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659442048 00000100:00100000:1.0:1783349800.847479:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659442048 00000100:00100000:1.0:1783349800.847509:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659441920 00000100:00100000:1.0:1783349800.847512:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659441920 00000100:00100000:1.0:1783349800.847525:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783349800.847532:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659441792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.847587:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659441792:12345-0@lo:400:kworker.0 Request processed in 55us (7883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.847593:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783349800.847607:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783349800.847612:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659441536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.847655:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659441536:12345-0@lo:400:kworker.0 Request processed in 42us (7683us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.847660:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783349800.847671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783349800.847677:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659442048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.847706:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659442048:12345-0@lo:400:kworker.0 Request processed in 29us (7684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.847712:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783349800.847725:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783349800.847731:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659441920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.847759:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659441920:12345-0@lo:400:kworker.0 Request processed in 28us (7574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.847765:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1783349800.847792:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349800.847797:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783349800.847800:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783349800.847803:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349800.847826:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349800.847852:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659442816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349800.847888:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349800.848345:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659441664 00000100:00100000:0.0:1783349800.848354:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659441664 00000100:00100000:0.0:1783349800.848384:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783349800.848391:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659441664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349800.848435:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659441664:12345-0@lo:400:kworker.0 Request processed in 44us (8588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349800.848440:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783349800.848492:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659441664:0@lo:400:kworker.0 00010000:00080000:0.0:1783349800.848513:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437fce00 x1869977659442176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349800.848524:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659442176:0@lo:400:kworker.0 00010000:00080000:0.0:1783349800.848535:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437fd180 x1869977659442688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349800.848542:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659442688:0@lo:400:kworker.0 00000100:00100000:0.0:1783349800.848554:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659441792:0@lo:400:kworker.0 00010000:00080000:0.0:1783349800.848567:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437fe300 x1869977659442304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349800.848576:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659442304:0@lo:400:kworker.0 00010000:00080000:0.0:1783349800.848593:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243202680 x1869977659441280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349800.848608:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659441280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349800.848719:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659442816 00000100:00100000:3.0:1783349800.848724:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659442816 00000100:00100000:3.0:1783349800.848762:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783349800.848770:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659442816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349800.848786:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349800.848828:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659442816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349800.848834:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1783349800.850696:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370df6300 x1869977659442816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349800.850724:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659442816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349800.855706:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659441408 00000100:00100000:0.0:1783349800.855740:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659441408 00000100:00100000:0.0:1783349800.855805:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1783349800.855816:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659441408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.855831:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349800.855903:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659441408:12345-0@lo:400:kworker.0 Request processed in 89us (15796us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.855908:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659441536:0@lo:400:kworker.0 00000100:00100000:0.0:1783349800.855914:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00010000:00080000:1.0:1783349800.855931:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437fea00 x1869977659442048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349800.855942:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659442048:0@lo:400:kworker.0 00000100:00100000:0.0:1783349800.855967:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659442560 00000100:00100000:0.0:1783349800.855973:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659442560 00000100:00100000:0.0:1783349800.856023:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783349800.856030:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659442560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349800.856066:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659442560:12345-0@lo:400:kworker.0 Request processed in 36us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349800.856073:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1783349800.857710:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783349800.857786:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437ff800 x1869977659442560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349800.857802:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659442560:0@lo:400:kworker.0 00000100:00100000:2.0:1783349800.858709:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659441920:0@lo:400:kworker.0 00000100:00100000:2.0:1783349800.858725:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659442432:0@lo:400:kworker.0 00000100:00100000:2.0:1783349800.858788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349800.858893:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659441408:0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.864372:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659442432 00000100:00100000:1.0:1783349800.864387:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659442432 00000100:00080000:3.0:1783349800.864500:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349800.865107:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783349800.865123:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659442432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349800.865589:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659442432:12345-0@lo:400:kworker.0 Request processed in 230us (6560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349800.865598:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783349800.865900:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659442432:0@lo:400:kworker.0 00010000:00010000:3.0:1783349801.607993:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349802.372521:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349802.372545:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659442944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349802.372656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349802.372880:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659442944 00000100:00100000:3.0:1783349802.372888:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659442944 00000100:00100000:3.0:1783349802.372947:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783349802.372955:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659442944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783349802.372981:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349802.373023:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659442944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349802.373030:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1783349802.373316:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783349802.373353:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243203800 x1869977659442944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349802.373371:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659442944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349802.380030:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349802.380058:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659443072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349802.380133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349802.380214:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659443072 00000100:00100000:2.0:1783349802.380224:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659443072 00000100:00100000:2.0:1783349802.380290:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349802.380302:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659443072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349802.380350:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349802.380394:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659443072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349802.380401:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1783349802.380425:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783349802.380453:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243203800 x1869977659443072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349802.380474:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659443072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783349802.634727:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349803.653275:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783349803.991744:0:10691:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1783349804.420481:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659443200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783349804.420586:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349804.420875:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659443200 00000100:00100000:1.0:1783349804.420885:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659443200 00000100:00100000:1.0:1783349804.420952:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783349804.420971:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659443200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783349804.421010:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783349804.421086:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659443200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349804.421093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783349804.421269:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659443200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349804.637380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349804.637424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349804.637460:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642605824 00000100:00100000:0.0:1783349804.637470:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642605824 00000100:00100000:0.0:1783349804.637552:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:0.0:1783349804.637562:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642605824:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349804.637648:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642605824:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 87us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349804.637656:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:0.0:1783349804.637682:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642606080 00000100:00100000:0.0:1783349804.637685:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642606080 00000100:00100000:0.0:1783349804.637717:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:0.0:1783349804.637724:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642606080:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349804.637768:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642606080:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 44us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349804.639111:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00080000:0.0:1783349804.639166:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349804.639172:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349804.642016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349804.642063:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349804.642094:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349804.642120:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642605952 00000100:00100000:3.0:1783349804.642130:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642605952 00000100:00100000:3.0:1783349804.642213:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:3.0:1783349804.642223:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642605952:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349804.642324:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642605952:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 102us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349804.642332:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:3.0:1783349804.642398:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642606208 00000100:00100000:3.0:1783349804.642402:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642606208 00000100:00100000:3.0:1783349804.642433:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:3.0:1783349804.642441:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642606208:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349804.642469:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642606208:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349804.642476:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:0.0:1783349804.642603:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642605696 00000100:00100000:0.0:1783349804.642607:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642605696 00000100:00100000:0.0:1783349804.642635:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 273 00000100:00100000:0.0:1783349804.642641:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2400:x1869977642605696:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349804.642666:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2400:x1869977642605696:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349804.642672:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 273 00000100:00080000:3.0:1783349804.646237:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349804.646248:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783349804.691597:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349805.701364:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349805.956365:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659443328:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.956458:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.956646:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659443840:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.956679:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.956707:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659444352:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.956732:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.956751:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659444864:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.956770:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.956843:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783349805.956851:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659443712:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.956877:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.956895:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659444224:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.957571:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.957595:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659444736:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.957619:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.957649:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659443456:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.957675:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.957695:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659443968:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.957717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.957732:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659444480:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.957753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.957767:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659444992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349805.957788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.957808:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1783349805.957815:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659443584:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.957837:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.957854:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659444096:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.957891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.957903:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659444608:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.957937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.957947:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659445120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349805.957965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.958001:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659444352 00000100:00100000:2.0:1783349805.958009:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659444352 00000100:00100000:2.0:1783349805.958066:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659444864 00000100:00100000:2.0:1783349805.958070:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659444864 00000100:00100000:2.0:1783349805.958084:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659444224 00000100:00100000:2.0:1783349805.958093:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659444224 00000100:00100000:2.0:1783349805.958112:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659444736 00000100:00100000:2.0:1783349805.958114:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659444736 00000100:00100000:2.0:1783349805.958131:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349805.958166:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659444352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.958224:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659444352:12345-0@lo:400:kworker.0 Request processed in 59us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958232:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349805.958249:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349805.958255:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659444864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.958296:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659444864:12345-0@lo:400:kworker.0 Request processed in 42us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958302:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349805.958313:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349805.958319:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659444224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.958344:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659444224:12345-0@lo:400:kworker.0 Request processed in 26us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958350:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349805.958360:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349805.958365:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659444736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.958391:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659444736:12345-0@lo:400:kworker.0 Request processed in 26us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958397:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349805.958423:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659443712 00000100:00100000:2.0:1783349805.958427:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659443712 00000100:00100000:2.0:1783349805.958447:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659443456 00000100:00100000:2.0:1783349805.958449:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659443456 00000100:00100000:2.0:1783349805.958470:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659443968 00000100:00100000:2.0:1783349805.958473:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659443968 00000100:00100000:2.0:1783349805.958486:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659444480 00000100:00100000:2.0:1783349805.958488:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659444480 00000100:00100000:2.0:1783349805.958499:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659444096 00000100:00100000:2.0:1783349805.958502:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659444096 00000100:00100000:2.0:1783349805.958512:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659444608 00000100:00100000:2.0:1783349805.958514:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659444608 00000100:00100000:2.0:1783349805.958527:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783349805.958533:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659443712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.958566:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659443712:12345-0@lo:400:kworker.0 Request processed in 34us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958572:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783349805.958582:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783349805.958587:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659443456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.958619:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659443456:12345-0@lo:400:kworker.0 Request processed in 31us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958624:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783349805.958634:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783349805.958640:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659443968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.958664:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659443968:12345-0@lo:400:kworker.0 Request processed in 25us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958670:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783349805.958680:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783349805.958686:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659444480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.958713:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659444480:12345-0@lo:400:kworker.0 Request processed in 29us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958730:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783349805.958741:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783349805.958747:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659444096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.958777:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659444096:12345-0@lo:400:kworker.0 Request processed in 30us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958782:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783349805.958792:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783349805.958798:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659444608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.958823:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659444608:12345-0@lo:400:kworker.0 Request processed in 26us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958828:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783349805.958848:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659444992 00000100:00100000:2.0:1783349805.958851:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659444992 00000100:00100000:2.0:1783349805.958867:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659445120 00000100:00100000:2.0:1783349805.958870:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659445120 00000100:00100000:2.0:1783349805.958881:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349805.958887:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659444992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783349805.958908:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349805.958939:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659444992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.958944:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349805.958955:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783349805.958960:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659445120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349805.958969:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349805.958991:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659445120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.959005:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783349805.959023:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659443840 00000100:00100000:2.0:1783349805.959027:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659443840 00000100:00100000:2.0:1783349805.959051:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659443584 00000100:00100000:2.0:1783349805.959054:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659443584 00000100:00100000:2.0:1783349805.959066:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783349805.959071:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659443840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.959102:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659443840:12345-0@lo:400:kworker.0 Request processed in 30us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.959108:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783349805.959117:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783349805.959122:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659443584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.959165:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659443584:12345-0@lo:400:kworker.0 Request processed in 43us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.959170:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783349805.959194:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659445248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349805.959212:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659443584:0@lo:400:kworker.0 00000100:00100000:0.0:1783349805.959227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783349805.959228:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243201500 x1869977659444096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349805.959238:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659444096:0@lo:400:kworker.0 00010000:00080000:2.0:1783349805.959247:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2438bb480 x1869977659444608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349805.959255:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659444608:0@lo:400:kworker.0 00010000:00080000:2.0:1783349805.959266:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243114380 x1869977659445120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349805.959270:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659445248 00000100:00100000:0.0:1783349805.959273:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659445248 00000100:00100000:2.0:1783349805.959302:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659445120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349805.959306:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783349805.959312:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659445248:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349805.959316:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659443456:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.959326:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659443968:0@lo:400:kworker.0 00000004:00000024:0.0:1783349805.959334:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349805.959336:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659444480:0@lo:400:kworker.0 00010000:00080000:2.0:1783349805.959345:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243722680 x1869977659444992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349805.959356:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659444992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349805.959363:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659445248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349805.959368:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783349805.959393:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659445248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349805.959424:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659443712:0@lo:400:kworker.0 00010000:00080000:2.0:1783349805.959437:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243202300 x1869977659444224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349805.959447:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659444224:0@lo:400:kworker.0 00010000:00080000:2.0:1783349805.959457:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48ed80 x1869977659444736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349805.959464:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659444736:0@lo:400:kworker.0 00000100:00100000:2.0:1783349805.959472:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659443840:0@lo:400:kworker.0 00010000:00080000:2.0:1783349805.959481:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243202680 x1869977659444352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349805.959488:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659443328 00000100:00100000:2.0:1783349805.959489:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659444352:0@lo:400:kworker.0 00000100:00100000:3.0:1783349805.959492:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659443328 00010000:00080000:2.0:1783349805.959497:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea379139500 x1869977659444864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349805.959510:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659444864:0@lo:400:kworker.0 00000100:00100000:3.0:1783349805.959527:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783349805.959533:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659443328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349805.959573:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659443328:12345-0@lo:400:kworker.0 Request processed in 40us (3116us total) trans 0 rc 0/0 00000100:00080000:2.0:1783349805.959577:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783349805.959579:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:2.0:1783349805.959581:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349805.959584:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349805.959586:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349805.959605:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659443328:0@lo:400:kworker.0 00010000:00010000:3.0:1783349806.726793:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349807.494666:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349807.494689:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659445376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349807.494751:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349807.497446:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659445376 00000100:00100000:2.0:1783349807.497460:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659445376 00000100:00100000:2.0:1783349807.497520:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349807.497530:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659445376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349807.497562:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349807.497640:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659445376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349807.497647:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349807.497684:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659445504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349807.497719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783349807.497762:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349807.497772:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659445504 00000100:00100000:2.0:1783349807.497775:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659445504 00000100:00100000:2.0:1783349807.497798:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783349807.497804:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659445504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783349807.497814:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349807.497843:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659445504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349807.497849:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1783349807.497870:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783349807.497895:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243720700 x1869977659445504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349807.497913:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659445504:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1783349807.497940:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243115c00 x1869977659445376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349807.497951:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659445376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783349807.748493:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349808.776459:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349809.133344:0:10934:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing yml_node 00000100:00100000:2.0:1783349809.540467:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659445632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783349809.540542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349809.540694:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659445632 00000100:00100000:1.0:1783349809.540703:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659445632 00000100:00100000:1.0:1783349809.540758:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783349809.540768:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659445632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783349809.540803:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783349809.540960:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659445632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 192us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349809.540968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783349809.541049:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659445632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783349809.753053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349809.753094:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642606336 00000100:00100000:3.0:1783349809.753103:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642606336 00000100:00100000:3.0:1783349809.753170:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 275 00000100:00100000:3.0:1783349809.753181:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2400:x1869977642606336:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349809.753249:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2400:x1869977642606336:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349809.753274:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 275 00000100:00100000:1.0:1783349809.766881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349809.766919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349809.766937:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349809.766955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349809.766977:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642606720 00000100:00100000:1.0:1783349809.766986:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642606720 00000100:00100000:1.0:1783349809.767032:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642606848 00000100:00100000:1.0:1783349809.767034:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642606848 00000100:00100000:1.0:1783349809.767070:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:1.0:1783349809.767081:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642606720:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349809.767178:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642606720:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 99us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349809.767187:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:1.0:1783349809.767203:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:1.0:1783349809.767209:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642606848:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349809.767234:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642606848:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349809.767240:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:1.0:1783349809.767267:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642606464 00000100:00100000:1.0:1783349809.767270:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642606464 00000100:00100000:1.0:1783349809.767297:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642606592 00000100:00100000:1.0:1783349809.767300:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642606592 00000100:00100000:1.0:1783349809.767320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:1.0:1783349809.767327:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642606464:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349809.767356:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642606464:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 30us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349809.767363:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:1.0:1783349809.767373:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:1.0:1783349809.767378:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642606592:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349809.767397:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642606592:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 19us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349809.767402:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00080000:1.0:1783349809.767417:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783349809.767427:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349809.767430:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349809.767432:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783349809.799196:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349810.821603:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349811.077309:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349811.077334:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659445760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349811.077408:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349811.077556:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659445760 00000100:00100000:0.0:1783349811.077576:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659445760 00000100:00100000:0.0:1783349811.077632:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783349811.077642:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659445760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783349811.077678:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783349811.077734:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659445760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349811.077742:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783349811.077846:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659445760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349811.078296:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659445888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349811.078333:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349811.078529:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659445888 00000100:00100000:1.0:1783349811.078534:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659445888 00000100:00100000:1.0:1783349811.078580:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783349811.078590:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659445888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349811.078610:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349811.078644:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659445888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349811.078651:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1783349811.078707:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349811.078763:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659446016:0@lo:400:kworker.0 00000100:00100000:2.0:1783349811.078797:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349811.078826:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659446528:0@lo:400:kworker.0 00000100:00100000:2.0:1783349811.078848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349811.078870:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659447040:0@lo:400:kworker.0 00000100:00100000:2.0:1783349811.078889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349811.078906:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783349811.078911:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659446144:0@lo:400:kworker.0 00000100:00100000:2.0:1783349811.078931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349811.078945:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659446656:0@lo:400:kworker.0 00000100:00100000:2.0:1783349811.078963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349811.078987:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659447168:0@lo:400:kworker.0 00000100:00100000:0.0:1783349811.079239:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659446016 00000100:00100000:0.0:1783349811.079251:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659446016 00000100:00100000:0.0:1783349811.079280:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1783349811.079287:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659446016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349811.079324:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659446016:12345-0@lo:400:kworker.0 Request processed in 37us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349811.079330:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1783349811.079381:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659446272:0@lo:400:kworker.0 00000100:00100000:0.0:1783349811.079406:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349811.079422:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659446784:0@lo:400:kworker.0 00000100:00100000:0.0:1783349811.079444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349811.079457:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659447296:0@lo:400:kworker.0 00000100:00100000:0.0:1783349811.079476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349811.079494:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783349811.079499:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659446400:0@lo:400:kworker.0 00010000:00080000:0.0:1783349811.079544:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243116680 x1869977659445888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349811.079559:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659445888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349811.079718:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659446528 00000100:00100000:1.0:1783349811.079722:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659446528 00000100:00100000:1.0:1783349811.079759:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659447040 00000100:00100000:1.0:1783349811.079762:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659447040 00000100:00100000:1.0:1783349811.079776:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659446144 00000100:00100000:1.0:1783349811.079779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659446144 00000100:00100000:1.0:1783349811.079789:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659446656 00000100:00100000:1.0:1783349811.079791:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659446656 00000100:00100000:1.0:1783349811.079804:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783349811.079810:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659446528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349811.079845:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659446528:12345-0@lo:400:kworker.0 Request processed in 35us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349811.079851:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783349811.079864:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783349811.079870:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659447040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349811.079896:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659447040:12345-0@lo:400:kworker.0 Request processed in 27us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349811.079910:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783349811.079922:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783349811.079928:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659446144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349811.079972:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659446144:12345-0@lo:400:kworker.0 Request processed in 44us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349811.079979:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783349811.079990:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783349811.079996:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659446656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349811.080363:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659446656:12345-0@lo:400:kworker.0 Request processed in 366us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349811.080370:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783349811.080396:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659446272 00000100:00100000:1.0:1783349811.080401:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659446272 00000100:00100000:1.0:1783349811.080424:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783349811.080430:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659446272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349811.080460:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659446272:12345-0@lo:400:kworker.0 Request processed in 30us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349811.080465:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783349811.080478:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659446784 00000100:00100000:1.0:1783349811.080481:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659446784 00000100:00100000:1.0:1783349811.080501:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659447296 00000100:00100000:1.0:1783349811.080504:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659447296 00000100:00100000:1.0:1783349811.080520:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783349811.080525:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659446784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349811.080551:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659446784:12345-0@lo:400:kworker.0 Request processed in 26us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349811.080568:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783349811.080577:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783349811.080583:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659447296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349811.080609:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659447296:12345-0@lo:400:kworker.0 Request processed in 26us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349811.080614:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783349811.080688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349811.080730:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659446016:0@lo:400:kworker.0 00000100:00100000:2.0:1783349811.080743:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659446528:0@lo:400:kworker.0 00000100:00100000:2.0:1783349811.080753:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659447040:0@lo:400:kworker.0 00000100:00100000:2.0:1783349811.080786:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659446144:0@lo:400:kworker.0 00010000:00080000:2.0:1783349811.080798:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243146a00 x1869977659446656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349811.080807:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659446656:0@lo:400:kworker.0 00000100:00100000:3.0:1783349811.080924:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659447168 00000100:00100000:3.0:1783349811.080928:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659447168 00000100:00100000:3.0:1783349811.080957:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783349811.080963:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659447168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349811.081000:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659447168:12345-0@lo:400:kworker.0 Request processed in 37us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349811.081025:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1783349811.081390:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349811.081395:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349811.081397:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349811.081399:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349811.081412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349811.081444:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659446912:0@lo:400:kworker.0 00000100:00100000:0.0:1783349811.081475:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349811.081500:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659446272:0@lo:400:kworker.0 00010000:00080000:0.0:1783349811.081511:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243145500 x1869977659446784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349811.081521:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659446784:0@lo:400:kworker.0 00010000:00080000:0.0:1783349811.081531:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243144380 x1869977659447296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349811.081539:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659447296:0@lo:400:kworker.0 00000100:00100000:0.0:1783349811.081554:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783349811.081564:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659447424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349811.081587:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349811.081616:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659447424 00000100:00100000:0.0:1783349811.081619:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659447424 00000100:00100000:0.0:1783349811.081645:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783349811.081652:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659447424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783349811.081667:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349811.081699:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659447424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349811.081705:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783349811.081735:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659446912 00000100:00100000:0.0:1783349811.081739:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659446912 00000100:00100000:0.0:1783349811.081765:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783349811.081771:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659446912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349811.081801:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659446912:12345-0@lo:400:kworker.0 Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349811.081807:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1783349811.081820:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783349811.081840:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243722680 x1869977659447424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349811.081854:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659447424:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1783349811.081864:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243146d80 x1869977659446912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349811.081872:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659446912:0@lo:400:kworker.0 00000100:00100000:1.0:1783349811.081950:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659446400 00000100:00100000:1.0:1783349811.081954:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659446400 00000100:00100000:1.0:1783349811.081986:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783349811.081994:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659446400:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1783349811.082335:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243147480 x1869977659447168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349811.082345:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659447168:0@lo:400:kworker.0 00000100:00100000:1.0:1783349811.082449:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659446400:12345-0@lo:400:kworker.0 Request processed in 456us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349811.082455:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783349811.082567:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659446400:0@lo:400:kworker.0 00010000:00010000:1.0:1783349811.844383:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349812.612658:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349812.612683:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659447552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349812.612750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349812.612872:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659447552 00000100:00100000:3.0:1783349812.612881:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659447552 00000100:00100000:3.0:1783349812.612933:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783349812.612943:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659447552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783349812.612980:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349812.613026:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659447552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349812.613032:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1783349812.613408:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243722680 x1869977659447552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349812.613426:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659447552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349812.613603:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349812.613614:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659447680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349812.613647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349812.613806:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659447680 00000100:00100000:3.0:1783349812.613811:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659447680 00000100:00100000:3.0:1783349812.613844:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783349812.613850:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659447680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783349812.613863:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349812.613944:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659447680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349812.613972:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1783349812.615544:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243114000 x1869977659447680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349812.615568:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659447680:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1783349812.816191:0:11118:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.84 00010000:00010000:3.0:1783349812.868284:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349813.893098:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349814.660594:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659447808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349814.660672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349814.660735:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659447808 00000100:00100000:0.0:1783349814.660745:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659447808 00000100:00100000:0.0:1783349814.660805:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783349814.660814:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659447808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783349814.660849:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783349814.660919:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659447808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349814.660927:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783349814.661028:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659447808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349814.871463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349814.871501:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349814.871570:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349814.871615:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642606976 00000100:00100000:3.0:1783349814.871626:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642606976 00000100:00100000:3.0:1783349814.871687:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 277 00000100:00100000:3.0:1783349814.871697:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2399:x1869977642606976:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349814.871767:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2399:x1869977642606976:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 71us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349814.871774:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 277 00000100:00100000:1.0:1783349814.872825:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642607232 00000100:00100000:1.0:1783349814.872834:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642607232 00000100:00100000:1.0:1783349814.872891:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642607104 00000100:00100000:1.0:1783349814.872895:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642607104 00000100:00100000:1.0:1783349814.872924:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:1.0:1783349814.872933:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642607232:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349814.872990:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642607232:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 58us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349814.873010:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:1.0:1783349814.873025:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:1.0:1783349814.873032:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642607104:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349814.873074:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642607104:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 42us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349814.873080:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00080000:0.0:1783349814.873409:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783349814.873414:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349814.877937:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349814.881364:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349814.885460:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642607360 00000100:00100000:1.0:1783349814.885476:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642607360 00000100:00100000:1.0:1783349814.885559:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642607488 00000100:00100000:1.0:1783349814.885563:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642607488 00000100:00100000:1.0:1783349814.885594:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:1.0:1783349814.885604:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36df48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2398:x1869977642607360:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:1.0:1783349814.885639:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e205a 00000100:00080000:1.0:1783349814.885648:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8ea2434dc800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783349814.885688:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1783349814.885839:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36df48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+2:2398:x1869977642607360:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 235us (7909us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349814.885846:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:1.0:1783349814.886015:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:1.0:1783349814.886023:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2398:x1869977642607488:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:1.0:1783349814.886036:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2061 00000100:00080000:1.0:1783349814.886043:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8ea2434de800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783349814.886067:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:0.0:1783349814.886227:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349814.886232:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349814.886366:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+2:2398:x1869977642607488:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 342us (5011us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349814.886391:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00010000:00010000:1.0:1783349814.886414:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349814.886420:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349814.916452:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783349815.072563:0:11215:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.84 00010000:00010000:1.0:1783349815.944636:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349816.196464:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659447936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349816.196540:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349816.196625:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659447936 00000100:00100000:0.0:1783349816.196633:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659447936 00000100:00100000:0.0:1783349816.196679:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783349816.196688:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659447936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783349816.196723:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783349816.196767:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659447936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349816.196774:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783349816.196820:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659447936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783349816.197067:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659448320:0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197098:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349816.197126:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659448832:0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197174:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349816.197199:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659449344:0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197233:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349816.197251:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783349816.197257:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659448448:0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349816.197298:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659448960:0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349816.197331:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659449472:0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197350:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349816.197378:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659448832 00000100:00100000:1.0:1783349816.197382:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659448832 00000100:00100000:1.0:1783349816.197414:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659449344 00000100:00100000:1.0:1783349816.197417:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659449344 00000100:00100000:1.0:1783349816.197430:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659448960 00000100:00100000:1.0:1783349816.197432:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659448960 00000100:00100000:1.0:1783349816.197445:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659449472 00000100:00100000:1.0:1783349816.197448:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659449472 00000100:00100000:1.0:1783349816.197462:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783349816.197486:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659448832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197527:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659448832:12345-0@lo:400:kworker.0 Request processed in 43us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349816.197535:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783349816.197549:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783349816.197556:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659449344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197584:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659449344:12345-0@lo:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349816.197589:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783349816.197600:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783349816.197606:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659448960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197638:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659448960:12345-0@lo:400:kworker.0 Request processed in 33us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349816.197644:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783349816.197655:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783349816.197661:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659449472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197688:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659449472:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349816.197693:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783349816.197712:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659448448 00000100:00100000:1.0:1783349816.197716:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659448448 00000100:00100000:1.0:1783349816.197742:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783349816.197749:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659448448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349816.197780:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659448448:12345-0@lo:400:kworker.0 Request processed in 32us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349816.197797:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1783349816.197820:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349816.197823:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349816.197849:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659448448:0@lo:400:kworker.0 00010000:00080000:1.0:1783349816.197863:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243145f80 x1869977659448960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349816.197880:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659448960:0@lo:400:kworker.0 00010000:00080000:1.0:1783349816.197891:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243146d80 x1869977659449472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349816.197900:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659449472:0@lo:400:kworker.0 00010000:00080000:1.0:1783349816.197910:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243147100 x1869977659448832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349816.197917:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659448832:0@lo:400:kworker.0 00010000:00080000:1.0:1783349816.197926:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243147480 x1869977659449344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349816.197934:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659449344:0@lo:400:kworker.0 00000100:00100000:2.0:1783349816.198036:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659448320 00000100:00100000:2.0:1783349816.198047:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659448320 00000100:00100000:2.0:1783349816.198084:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783349816.198092:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659448320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349816.198130:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659448320:12345-0@lo:400:kworker.0 Request processed in 40us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349816.198163:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783349816.198299:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659448064:0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.198331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349816.198492:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659448576:0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.198525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349816.198550:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659449088:0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.198570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349816.198589:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659449600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349816.198610:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349816.198631:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1783349816.198638:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659448192:0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.198660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349816.198675:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659448704:0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.198694:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349816.198707:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659449216:0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.198726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349816.198736:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659449728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349816.198755:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349816.198782:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659448576 00000100:00100000:0.0:1783349816.198787:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659448576 00000100:00100000:0.0:1783349816.198815:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659449088 00000100:00100000:0.0:1783349816.198818:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659449088 00000100:00100000:0.0:1783349816.198832:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659448192 00000100:00100000:0.0:1783349816.198834:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659448192 00000100:00100000:0.0:1783349816.198844:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659448704 00000100:00100000:0.0:1783349816.198846:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659448704 00000100:00100000:0.0:1783349816.198857:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659449216 00000100:00100000:0.0:1783349816.198859:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659449216 00000100:00100000:0.0:1783349816.198873:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783349816.198879:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659448576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.198918:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659448576:12345-0@lo:400:kworker.0 Request processed in 39us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349816.198932:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783349816.198947:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783349816.198953:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659449088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.198982:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659449088:12345-0@lo:400:kworker.0 Request processed in 30us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349816.198988:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783349816.198999:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783349816.199004:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659448192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.199030:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659448192:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349816.199036:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783349816.199046:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783349816.199051:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659448704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.199074:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659448704:12345-0@lo:400:kworker.0 Request processed in 23us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349816.199080:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783349816.199089:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783349816.199094:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659449216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.199114:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659449216:12345-0@lo:400:kworker.0 Request processed in 21us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349816.199120:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783349816.199162:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659449600 00000100:00100000:0.0:1783349816.199165:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659449600 00000100:00100000:0.0:1783349816.199182:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659449728 00000100:00100000:0.0:1783349816.199184:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659449728 00000100:00100000:0.0:1783349816.199218:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783349816.199224:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659449600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349816.199245:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349816.199273:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659449600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349816.199279:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783349816.199291:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783349816.199297:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659449728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783349816.199305:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349816.199326:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659449728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349816.199331:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783349816.199368:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659448192:0@lo:400:kworker.0 00010000:00080000:0.0:1783349816.199380:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243083100 x1869977659448704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349816.199388:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659448704:0@lo:400:kworker.0 00010000:00080000:0.0:1783349816.199397:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243145180 x1869977659449216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349816.199404:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659449216:0@lo:400:kworker.0 00010000:00080000:0.0:1783349816.199412:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243721500 x1869977659449728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349816.199425:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659449728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349816.199434:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659448576:0@lo:400:kworker.0 00000100:00100000:0.0:1783349816.199453:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659449088:0@lo:400:kworker.0 00010000:00080000:0.0:1783349816.199461:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243117b80 x1869977659449600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349816.199472:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659449600:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783349816.199635:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783349816.199639:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349816.199668:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659448320:0@lo:400:kworker.0 00000100:00100000:2.0:1783349816.201505:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659448064 00000100:00100000:2.0:1783349816.201518:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659448064 00000100:00100000:3.0:1783349816.201657:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1783349816.201668:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659448064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349816.201761:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659448064:12345-0@lo:400:kworker.0 Request processed in 95us (3428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349816.201768:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1783349816.201917:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659448064:0@lo:400:kworker.0 00010000:00010000:0.0:1783349816.964884:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783349817.415863:0:11312:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.84 00000100:00100000:0.0:1783349817.732626:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349817.732655:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659449856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349817.732748:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349817.732916:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659449856 00000100:00100000:1.0:1783349817.732925:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659449856 00000100:00100000:1.0:1783349817.733068:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783349817.733078:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659449856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349817.733107:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349817.733185:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659449856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349817.733230:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1783349817.733300:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243114a80 x1869977659449856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349817.733318:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659449856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349817.735661:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349817.735690:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659449984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349817.735756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349817.736984:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659449984 00000100:00100000:0.0:1783349817.736998:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659449984 00000100:00100000:0.0:1783349817.737044:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783349817.737114:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659449984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783349817.737245:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349817.737368:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659449984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 315us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349817.737376:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1783349817.737621:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243721880 x1869977659449984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349817.737644:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659449984:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783349817.988418:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783349818.946549:0:11361:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 6 10:56:56 EDT 2026 00010000:00010000:3.0:1783349819.012408:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349819.781440:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659450112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349819.781516:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349819.781890:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659450112 00000100:00100000:2.0:1783349819.781899:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659450112 00000100:00100000:2.0:1783349819.782068:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783349819.782078:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659450112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783349819.782115:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783349819.782220:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659450112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349819.782227:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783349819.782649:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659450112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349819.989691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349819.989739:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349819.989777:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349819.989808:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642607872 00000100:00100000:1.0:1783349819.989819:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642607872 00000100:00100000:1.0:1783349819.989871:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642607744 00000100:00100000:1.0:1783349819.989874:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642607744 00000100:00100000:1.0:1783349819.989895:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:1.0:1783349819.989914:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642607872:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349819.989981:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642607872:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349819.989988:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:1.0:1783349819.990003:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 89 00000100:00100000:1.0:1783349819.990009:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642607744:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349819.990030:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642607744:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349819.990037:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 89 00000100:00080000:1.0:1783349819.990051:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349819.990066:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349819.991418:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642607616 00000100:00100000:0.0:1783349819.991429:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642607616 00000100:00100000:0.0:1783349819.991484:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 279 00000100:00100000:0.0:1783349819.991493:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2401:x1869977642607616:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349819.991556:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2401:x1869977642607616:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 65us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349819.991578:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 279 00010000:00010000:0.0:1783349820.044410:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783349820.300722:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:0.0:1783349820.300731:0:9511:0:(genops.c:906:class_export_put()) final put ffff8ea2434da000/689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:2.0:1783349820.300859:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2434da000/689af055-7605-419d-81ba-26cff8cb556b for lustre-OST0001 00000020:00000080:2.0:1783349820.300910:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2434de800 for lustre-OST0001 00000001:00100000:0.0:1783349820.306416:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:0.0:1783349820.306424:0:8426:0:(genops.c:906:class_export_put()) final put ffff8ea2434d9000/689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:1.0:1783349820.307559:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2434d9000/689af055-7605-419d-81ba-26cff8cb556b for lustre-OST0000 00000020:00000080:1.0:1783349820.307748:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2434dc800 for lustre-OST0000 00010000:00010000:0.0:1783349821.066231:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349821.325397:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659450240:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325463:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325509:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659450752:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325553:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659451264:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325592:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659451776:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325611:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325634:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1783349821.325639:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659450624:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325677:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659451136:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325694:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325705:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659451648:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325731:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659452160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349821.325746:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325769:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659450368:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325789:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325802:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659450880:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325829:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659451392:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325860:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325876:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659451904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349821.325894:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325911:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1783349821.325916:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659450496:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325947:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659451008:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325963:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325971:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659451520:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.325987:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.325995:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659452032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349821.326010:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349821.326039:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659450240 00000100:00100000:2.0:1783349821.326046:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659450240 00000100:00100000:2.0:1783349821.326088:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783349821.326097:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659450240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.326174:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659450240:12345-0@lo:400:kworker.0 Request processed in 66us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326181:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783349821.326212:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659450752 00000100:00100000:2.0:1783349821.326216:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659450752 00000100:00100000:2.0:1783349821.326233:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659452160 00000100:00100000:2.0:1783349821.326236:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659452160 00000100:00100000:2.0:1783349821.326245:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659450496 00000100:00100000:2.0:1783349821.326247:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659450496 00000100:00100000:2.0:1783349821.326259:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783349821.326264:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1869977659450752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.326305:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1869977659450752:12345-0@lo:400:kworker.0 Request processed in 39us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326311:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783349821.326324:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783349821.326330:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659452160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783349821.326354:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349821.326386:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659452160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326392:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783349821.326404:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783349821.326409:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659450496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.326439:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659450496:12345-0@lo:400:kworker.0 Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326445:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783349821.326460:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659451264 00000100:00100000:2.0:1783349821.326464:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659451264 00000100:00100000:2.0:1783349821.326489:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659451776 00000100:00100000:2.0:1783349821.326492:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659451776 00000100:00100000:2.0:1783349821.326502:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659451136 00000100:00100000:2.0:1783349821.326504:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659451136 00000100:00100000:2.0:1783349821.326517:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659451648 00000100:00100000:2.0:1783349821.326520:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659451648 00000100:00100000:2.0:1783349821.326532:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349821.326538:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659451264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.326569:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659451264:12345-0@lo:400:kworker.0 Request processed in 31us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326575:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349821.326593:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783349821.326598:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659451776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.326627:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659451776:12345-0@lo:400:kworker.0 Request processed in 29us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326633:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783349821.326643:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349821.326648:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659451136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.326671:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659451136:12345-0@lo:400:kworker.0 Request processed in 23us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326677:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349821.326686:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783349821.326691:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659451648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.326716:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659451648:12345-0@lo:400:kworker.0 Request processed in 25us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326722:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783349821.326745:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659450624 00000100:00100000:2.0:1783349821.326748:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659450624 00000100:00100000:2.0:1783349821.326765:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659450368 00000100:00100000:2.0:1783349821.326768:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659450368 00000100:00100000:2.0:1783349821.326776:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659450880 00000100:00100000:2.0:1783349821.326779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659450880 00000100:00100000:2.0:1783349821.326789:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659451392 00000100:00100000:2.0:1783349821.326791:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659451392 00000100:00100000:2.0:1783349821.326801:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659451008 00000100:00100000:2.0:1783349821.326803:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659451008 00000100:00100000:2.0:1783349821.326814:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659451520 00000100:00100000:2.0:1783349821.326816:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659451520 00000100:00100000:2.0:1783349821.326828:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783349821.326834:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659450624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.326869:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659450624:12345-0@lo:400:kworker.0 Request processed in 35us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783349821.326888:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783349821.326893:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659450368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.326920:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659450368:12345-0@lo:400:kworker.0 Request processed in 27us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326926:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783349821.326937:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783349821.326942:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659450880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.326965:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659450880:12345-0@lo:400:kworker.0 Request processed in 23us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.326971:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783349821.326981:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783349821.326986:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659451392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.327011:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659451392:12345-0@lo:400:kworker.0 Request processed in 25us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.327017:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783349821.327027:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783349821.327033:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659451008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.327056:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659451008:12345-0@lo:400:kworker.0 Request processed in 24us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.327061:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783349821.327072:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783349821.327077:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659451520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.327110:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659451520:12345-0@lo:400:kworker.0 Request processed in 33us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.327116:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783349821.327154:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659451904 00000100:00100000:2.0:1783349821.327158:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659451904 00000100:00100000:2.0:1783349821.327184:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659452032 00000100:00100000:2.0:1783349821.327187:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659452032 00000100:00100000:2.0:1783349821.327198:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349821.327204:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659451904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349821.327222:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349821.327250:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659451904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.327256:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349821.327267:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783349821.327272:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659452032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783349821.327281:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349821.327302:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659452032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349821.327308:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783349821.327352:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659450496:0@lo:400:kworker.0 00010000:00080000:2.0:1783349821.327366:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243146680 x1869977659451008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349821.327378:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659451008:0@lo:400:kworker.0 00010000:00080000:2.0:1783349821.327387:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243147100 x1869977659451520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349821.327408:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659451520:0@lo:400:kworker.0 00010000:00080000:2.0:1783349821.327420:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36db7ce00 x1869977659452032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349821.327432:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659452032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349821.327443:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659450368:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.327452:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659450880:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.327462:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659451392:0@lo:400:kworker.0 00010000:00080000:2.0:1783349821.327470:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36db7d180 x1869977659451904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349821.327480:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659451904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349821.327529:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659450624:0@lo:400:kworker.0 00010000:00080000:2.0:1783349821.327539:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243147b80 x1869977659451136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349821.327548:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659451136:0@lo:400:kworker.0 00010000:00080000:2.0:1783349821.327557:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243146d80 x1869977659451648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349821.327564:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659451648:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.327576:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659452160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349821.327585:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659450240:0@lo:400:kworker.0 00000100:00100000:2.0:1783349821.327603:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659450752:0@lo:400:kworker.0 00010000:00080000:2.0:1783349821.327613:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243145180 x1869977659451264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349821.327619:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659451264:0@lo:400:kworker.0 00010000:00080000:2.0:1783349821.327627:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243145f80 x1869977659451776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349821.327634:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659451776:0@lo:400:kworker.0 00000100:00080000:1.0:1783349821.328386:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783349821.328392:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349821.328395:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349821.328397:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783349822.084379:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349822.852546:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659452288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349822.852634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349822.852753:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659452288 00000100:00100000:1.0:1783349822.852761:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659452288 00000100:00100000:1.0:1783349822.852811:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783349822.852822:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659452288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349822.852850:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349822.852900:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659452288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349822.852908:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1783349822.853131:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243114000 x1869977659452288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349822.853180:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659452288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349822.853819:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659452416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349822.853858:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349822.854467:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659452416 00000100:00100000:3.0:1783349822.854474:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659452416 00000100:00100000:3.0:1783349822.854518:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783349822.854534:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659452416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783349822.854554:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349822.854609:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659452416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349822.854625:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1783349822.854739:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243723100 x1869977659452416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349822.854755:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659452416:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783349823.112869:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349824.132536:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349824.902367:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659452544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783349824.902440:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349824.904738:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659452544 00000100:00100000:0.0:1783349824.904755:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659452544 00000100:00100000:0.0:1783349824.904826:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783349824.904838:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659452544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783349824.904898:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783349824.911874:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659452544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7028us (9423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349824.911888:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783349824.921545:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659452544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349825.111862:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349825.111902:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349825.111941:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349825.111973:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642608256 00000100:00100000:1.0:1783349825.111985:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642608256 00000100:00100000:1.0:1783349825.112040:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642608128 00000100:00100000:1.0:1783349825.112044:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642608128 00000100:00100000:1.0:1783349825.112068:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:1.0:1783349825.112078:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642608256:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349825.112204:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642608256:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 127us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.112212:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:1.0:1783349825.112229:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 97 00000100:00100000:1.0:1783349825.112250:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642608128:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349825.112278:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642608128:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.112284:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 97 00000100:00080000:1.0:1783349825.112301:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349825.112305:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783349825.112648:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642608000 00000100:00100000:3.0:1783349825.112653:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642608000 00000100:00100000:3.0:1783349825.112679:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 281 00000100:00100000:3.0:1783349825.112691:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2402:x1869977642608000:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349825.112726:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2402:x1869977642608000:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 35us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349825.112732:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 281 00010000:00010000:1.0:1783349825.156667:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349826.185267:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349826.437425:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349826.437453:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659452672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349826.437518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.437585:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659452672 00000100:00100000:2.0:1783349826.437593:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659452672 00000100:00100000:2.0:1783349826.437662:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783349826.437673:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659452672:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349826.437691:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659452928:0@lo:400:kworker.0 00002000:00000024:2.0:1783349826.437701:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349826.437725:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.437737:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659452672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349826.437744:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783349826.437746:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659453440:0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.437769:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349826.437799:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659453952:0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.437822:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349826.437843:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783349826.437848:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659453056:0@lo:400:kworker.0 00000100:00100000:2.0:1783349826.437867:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659453440 00000100:00100000:2.0:1783349826.437871:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659453440 00000100:00100000:1.0:1783349826.437873:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349826.437889:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659453568:0@lo:400:kworker.0 00000100:00100000:2.0:1783349826.437902:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783349826.437912:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.437918:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659453440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.437926:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659454080:0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.437945:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.437949:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659453440:12345-0@lo:400:kworker.0 Request processed in 42us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349826.437955:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783349826.437974:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659453440:0@lo:400:kworker.0 00000100:00080000:1.0:1783349826.438000:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349826.438012:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659452928 00000100:00100000:1.0:1783349826.438015:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659452928 00000100:00100000:2.0:1783349826.438339:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659453952 00000100:00100000:2.0:1783349826.438344:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659453952 00000100:00100000:0.0:1783349826.438348:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659453184:0@lo:400:kworker.0 00000100:00100000:2.0:1783349826.438385:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783349826.438390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.438397:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659453952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349826.438417:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659453696:0@lo:400:kworker.0 00000100:00100000:2.0:1783349826.438443:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659453952:12345-0@lo:400:kworker.0 Request processed in 48us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349826.438451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.438455:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783349826.438459:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783349826.438468:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659452928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349826.438479:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659454208:0@lo:400:kworker.0 00000100:00100000:2.0:1783349826.438483:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659452800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349826.438506:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659452928:12345-0@lo:400:kworker.0 Request processed in 40us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.438513:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783349826.438516:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349826.438530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.438537:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659453312:0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.438545:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659453056 00000100:00100000:1.0:1783349826.438549:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659453056 00000100:00100000:2.0:1783349826.438563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349826.438572:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659453184 00000100:00100000:1.0:1783349826.438574:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659453568 00000100:00100000:2.0:1783349826.438577:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659453824:0@lo:400:kworker.0 00000100:00100000:0.0:1783349826.438578:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659453184 00000100:00100000:1.0:1783349826.438579:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659453568 00000100:00100000:1.0:1783349826.438598:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659454080 00000100:00100000:1.0:1783349826.438601:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659454080 00000100:00100000:2.0:1783349826.438603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349826.438624:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659453696 00000100:00100000:0.0:1783349826.438625:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783349826.438628:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659453696 00000100:00100000:0.0:1783349826.438638:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659453184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349826.438644:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659454336:0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.438644:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659454208 00000100:00100000:1.0:1783349826.438647:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659454208 00000100:00100000:1.0:1783349826.438662:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659453312 00000100:00100000:1.0:1783349826.438664:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659453312 00000100:00100000:2.0:1783349826.438666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349826.438679:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783349826.438687:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659453056:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1783349826.438696:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243144a80 x1869977659452672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349826.438698:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659453184:12345-0@lo:400:kworker.0 Request processed in 61us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349826.438714:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783349826.438721:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659452672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349826.438721:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659453056:12345-0@lo:400:kworker.0 Request processed in 36us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.438728:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783349826.438745:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783349826.438749:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659452800 00000100:00100000:2.0:1783349826.438754:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659452800 00000100:00100000:0.0:1783349826.438756:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659453568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349826.438782:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783349826.438791:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659452800:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349826.438798:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659453568:12345-0@lo:400:kworker.0 Request processed in 43us (882us total) trans 0 rc 0/0 00002000:00000024:2.0:1783349826.438805:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349826.438839:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659452800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349826.438845:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1783349826.438867:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243114380 x1869977659452800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349826.438878:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659452800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349826.439767:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783349826.439783:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659454080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.439833:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659454080:12345-0@lo:400:kworker.0 Request processed in 56us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.439840:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783349826.439859:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783349826.439865:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659453696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.439904:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659453696:12345-0@lo:400:kworker.0 Request processed in 40us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.439911:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783349826.439924:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783349826.439930:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659454208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.439957:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659454208:12345-0@lo:400:kworker.0 Request processed in 27us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.439963:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783349826.439974:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783349826.439980:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659453312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.440021:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659453312:12345-0@lo:400:kworker.0 Request processed in 41us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.440026:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783349826.440068:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659453824 00000100:00100000:1.0:1783349826.440072:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659453824 00000100:00100000:1.0:1783349826.440099:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659454336 00000100:00100000:3.0:1783349826.440471:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659453312:0@lo:400:kworker.0 00000100:00100000:0.0:1783349826.441221:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783349826.441253:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349826.441268:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659454464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349826.441315:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349826.441357:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659454464 00000100:00100000:0.0:1783349826.441362:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659454464 00000100:00100000:0.0:1783349826.441391:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783349826.441398:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659454464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783349826.441858:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783349826.441910:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659454464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 512us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349826.441917:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783349826.442489:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659454336 00000100:00100000:1.0:1783349826.442535:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783349826.442545:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659453824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.442597:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659453824:12345-0@lo:400:kworker.0 Request processed in 55us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.442604:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783349826.442617:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783349826.442624:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659454336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349826.442651:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659454336:12345-0@lo:400:kworker.0 Request processed in 29us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.442673:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783349826.442683:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659454464:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1783349826.442704:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349826.442710:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783349826.442713:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349826.442717:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349826.442732:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659453184:0@lo:400:kworker.0 00010000:00080000:0.0:1783349826.442879:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243083100 x1869977659453696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349826.442892:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659453696:0@lo:400:kworker.0 00010000:00080000:0.0:1783349826.442904:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cce9500 x1869977659454208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349826.442913:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659454208:0@lo:400:kworker.0 00010000:00080000:3.0:1783349826.443644:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243080a80 x1869977659453824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349826.443658:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659453824:0@lo:400:kworker.0 00010000:00080000:3.0:1783349826.443673:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36ccea680 x1869977659454336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349826.443677:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659453056:0@lo:400:kworker.0 00000100:00100000:3.0:1783349826.443690:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659454336:0@lo:400:kworker.0 00000100:00100000:0.0:1783349826.443705:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659453568:0@lo:400:kworker.0 00000100:00100000:0.0:1783349826.443723:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659454080:0@lo:400:kworker.0 00000100:00100000:0.0:1783349826.443733:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659452928:0@lo:400:kworker.0 00010000:00080000:0.0:1783349826.443828:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243080380 x1869977659453952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349826.443839:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659453952:0@lo:400:kworker.0 00010000:00010000:0.0:1783349827.206690:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349827.973092:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783349827.973124:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659454592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349827.973205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349827.973285:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659454592 00000100:00100000:0.0:1783349827.973292:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659454592 00000100:00100000:0.0:1783349827.973343:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783349827.973353:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659454592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783349827.973381:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349827.973991:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783349827.974002:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659454720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349827.974036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349827.974065:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1783349827.974073:0:8435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1783349827.974180:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659454720 00000100:00100000:1.0:1783349827.974185:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659454720 00000100:00100000:0.0:1783349827.975565:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659454592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2206us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349827.975578:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783349827.975610:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783349827.975621:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659454720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349827.975643:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349827.975704:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659454720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349827.975711:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1783349827.975759:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da4e00 x1869977659454720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349827.975779:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659454720:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1783349827.978323:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36db7d500 x1869977659454592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349827.978804:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659454592:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783349828.228944:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349829.252560:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349830.020551:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349830.020577:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659454848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783349830.020650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349830.021035:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659454848 00000100:00100000:1.0:1783349830.021044:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659454848 00000100:00100000:1.0:1783349830.021106:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783349830.021115:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659454848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783349830.021183:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783349830.021244:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659454848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349830.021251:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783349830.021423:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659454848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349830.233019:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349830.233055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349830.233163:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349830.233193:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642608512 00000100:00100000:1.0:1783349830.233201:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642608512 00000100:00100000:1.0:1783349830.233253:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642608640 00000100:00100000:1.0:1783349830.233256:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642608640 00000100:00100000:1.0:1783349830.233562:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 104 00000100:00100000:1.0:1783349830.233584:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642608512:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349830.233607:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 105 00000100:00100000:2.0:1783349830.233617:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642608640:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349830.233656:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642608640:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 41us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349830.233656:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642608512:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 73us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349830.233663:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 104 00000100:00100000:2.0:1783349830.233670:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 105 00000100:00080000:1.0:1783349830.233684:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783349830.233687:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349830.234358:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642608384 00000100:00100000:0.0:1783349830.234367:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642608384 00000100:00100000:0.0:1783349830.234436:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 283 00000100:00100000:0.0:1783349830.234446:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2402:x1869977642608384:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349830.234491:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2402:x1869977642608384:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 47us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349830.234498:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 283 00010000:00010000:0.0:1783349830.277223:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349831.300482:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349831.556473:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659454976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349831.556473:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659455360:0@lo:400:kworker.0 00000100:00100000:1.0:1783349831.556585:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659455488:0@lo:400:kworker.0 00000100:00100000:0.0:1783349831.560405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349831.560567:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659455872:0@lo:400:kworker.0 00000100:00100000:0.0:1783349831.560605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349831.560655:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659456384:0@lo:400:kworker.0 00000100:00100000:0.0:1783349831.560695:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349831.560745:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659455872 00000100:00100000:0.0:1783349831.560754:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659455872 00000100:00100000:0.0:1783349831.560878:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659456384 00000100:00100000:0.0:1783349831.560890:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659456384 00000100:00100000:0.0:1783349831.560930:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783349831.560939:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659455872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349831.561011:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659455872:12345-0@lo:400:kworker.0 Request processed in 73us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349831.561019:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783349831.561036:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783349831.561042:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659456384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349831.561070:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659456384:12345-0@lo:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349831.561076:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1783349831.561108:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783349831.561192:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243766a00 x1869977659455872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349831.561218:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659455872:0@lo:400:kworker.0 00010000:00080000:0.0:1783349831.561232:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cf4e680 x1869977659456384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349831.561241:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659456384:0@lo:400:kworker.0 00000100:00100000:0.0:1783349831.561384:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659456896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349831.561454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349831.561523:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659456896 00000100:00100000:0.0:1783349831.561537:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659456896 00000100:00100000:0.0:1783349831.561604:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783349831.561611:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659456896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783349831.561632:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349831.561668:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659456896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349831.561674:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1783349831.561691:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783349831.561708:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36db7f800 x1869977659456896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349831.561754:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659456896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349831.561827:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659455360 00000100:00100000:0.0:1783349831.561843:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659455360 00000100:00100000:0.0:1783349831.561883:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783349831.561891:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659455360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349831.561962:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659455360:12345-0@lo:400:kworker.0 Request processed in 72us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349831.561969:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783349831.561995:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659455360:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.562663:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659455232:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.562733:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349831.562771:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659455232 00000100:00100000:2.0:1783349831.562777:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659455232 00000100:00100000:2.0:1783349831.562813:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783349831.562821:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659455232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.562860:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659455232:12345-0@lo:400:kworker.0 Request processed in 41us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349831.562867:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783349831.562914:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659455232:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.562925:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659455744:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.562947:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349831.562976:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659456256:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.562996:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349831.563018:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659455744 00000100:00100000:2.0:1783349831.563021:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659455744 00000100:00100000:2.0:1783349831.563049:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659456256 00000100:00100000:2.0:1783349831.563051:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659456256 00000100:00100000:2.0:1783349831.563068:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783349831.563074:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659455744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563118:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659455744:12345-0@lo:400:kworker.0 Request processed in 44us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349831.563124:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783349831.563154:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783349831.563174:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659456256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563205:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659456256:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349831.563211:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1783349831.563231:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349831.563254:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659456256:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563277:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659456768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349831.563301:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349831.563326:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659455744:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563338:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783349831.563344:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659455616:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349831.563388:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659456128:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563410:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349831.563427:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659456640:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563445:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349831.563480:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659455616 00000100:00100000:2.0:1783349831.563484:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659455616 00000100:00100000:2.0:1783349831.563513:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783349831.563519:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659455616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563566:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659455616:12345-0@lo:400:kworker.0 Request processed in 47us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349831.563571:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783349831.563594:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659455616:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563614:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659456768 00000100:00100000:2.0:1783349831.563623:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659456768 00000100:00100000:2.0:1783349831.563650:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783349831.563656:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659456768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349831.563672:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349831.563706:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659456768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349831.563711:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1783349831.563724:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783349831.563744:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36db7d880 x1869977659456768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349831.563759:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659456768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349831.563784:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659456128 00000100:00100000:2.0:1783349831.563787:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659456128 00000100:00100000:2.0:1783349831.563812:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659456640 00000100:00100000:2.0:1783349831.563815:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659456640 00000100:00100000:2.0:1783349831.563832:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783349831.563838:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659456128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563867:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659456128:12345-0@lo:400:kworker.0 Request processed in 30us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349831.563873:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783349831.563884:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783349831.563889:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659456640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.563927:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659456640:12345-0@lo:400:kworker.0 Request processed in 38us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349831.563932:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1783349831.563944:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783349831.563957:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243767480 x1869977659456128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349831.563971:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659456128:0@lo:400:kworker.0 00010000:00080000:2.0:1783349831.563981:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cf4df80 x1869977659456640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349831.563988:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659456640:0@lo:400:kworker.0 00000100:00100000:3.0:1783349831.564726:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349831.564757:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659455104:0@lo:400:kworker.0 00000100:00100000:3.0:1783349831.564789:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349831.564854:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659455104 00000100:00100000:3.0:1783349831.564859:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659455104 00000100:00100000:3.0:1783349831.565017:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783349831.565035:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659455104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349831.565076:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659455104:12345-0@lo:400:kworker.0 Request processed in 42us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349831.565096:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783349831.565151:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659455104:0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.565288:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659454976 00000100:00100000:2.0:1783349831.565293:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659454976 00000100:00100000:2.0:1783349831.565324:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783349831.565331:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659454976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783349831.565355:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349831.565394:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659454976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349831.565400:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783349831.565476:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659454976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783349831.567825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349831.567867:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659456000:0@lo:400:kworker.0 00000100:00100000:1.0:1783349831.567902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349831.567939:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659456512:0@lo:400:kworker.0 00000100:00100000:1.0:1783349831.567959:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349831.568311:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659455488 00000100:00100000:2.0:1783349831.568319:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659455488 00000100:00100000:2.0:1783349831.568379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783349831.568388:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659455488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349831.568447:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659455488:12345-0@lo:400:kworker.0 Request processed in 60us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349831.568455:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783349831.568566:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659455488:0@lo:400:kworker.0 00000100:00100000:0.0:1783349831.573807:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659456000 00000100:00100000:0.0:1783349831.573821:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659456000 00000100:00100000:0.0:1783349831.573919:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659456512 00000100:00100000:0.0:1783349831.573923:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659456512 00000100:00100000:0.0:1783349831.573961:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783349831.573971:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659456000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349831.574060:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783349831.574069:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659456512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349831.574072:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659456000:12345-0@lo:400:kworker.0 Request processed in 103us (6170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349831.574104:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783349831.574116:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659456512:12345-0@lo:400:kworker.0 Request processed in 50us (6156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349831.574122:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1783349831.574172:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783349831.574192:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243764a80 x1869977659456000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349831.574431:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659456000:0@lo:400:kworker.0 00010000:00080000:0.0:1783349831.574449:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cf4e300 x1869977659456512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349831.574457:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659456512:0@lo:400:kworker.0 00010000:00010000:0.0:1783349832.327177:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783349832.702590:0:11991:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:57:10 (1783349830) === 00000100:00100000:1.0:1783349833.092599:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659457152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783349833.092668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349833.092779:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659457024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349833.092820:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349833.092898:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659457152 00000100:00100000:1.0:1783349833.092905:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659457152 00000100:00100000:1.0:1783349833.092967:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659457024 00000100:00100000:1.0:1783349833.092970:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659457024 00000100:00100000:1.0:1783349833.092989:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783349833.093018:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659457152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783349833.093050:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349833.093106:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659457152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349833.093113:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783349833.093130:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783349833.093158:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659457024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349833.093169:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349833.093195:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659457024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349833.093201:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1783349833.093239:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243723100 x1869977659457152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349833.093254:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659457152:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783349833.093569:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783349833.093592:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cf4e300 x1869977659457024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349833.093605:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659457024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349833.180093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349833.180184:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642608768 00000100:00100000:0.0:1783349833.180194:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642608768 00000100:00100000:0.0:1783349833.180246:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 285 00000100:00100000:0.0:1783349833.180255:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:8705:x1869977642608768:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783349833.180270:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349833.180284:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e800/0xd05e6ae1590e214f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decda6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349833.180318:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e800/0xd05e6ae1590e214f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decda6 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349833.180345:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8e800/0xd05e6ae1590e214f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decda6 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349833.180353:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e800, rc 0) 00000100:00100000:0.0:1783349833.180407:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8705:x1869977642608768:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 153us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349833.180414:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 285 00000100:00100000:2.0:1783349833.187307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349833.191126:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642608896 00000100:00100000:3.0:1783349833.191160:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642608896 00000100:00100000:3.0:1783349833.191236:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 286 00000100:00100000:3.0:1783349833.191248:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8705:x1869977642608896:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783349833.191412:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8705:x1869977642608896:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 166us (4115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349833.191421:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 286 00000100:00100000:2.0:1783349833.202854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349833.208557:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642609024 00000100:00100000:3.0:1783349833.208574:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642609024 00000100:00100000:3.0:1783349833.217465:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 287 00000100:00100000:3.0:1783349833.217507:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8705:x1869977642609024:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783349833.217683:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8705:x1869977642609024:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 192us (14839us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349833.217691:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 287 00000100:00100000:1.0:1783349833.222511:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349833.222588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642609152 00000100:00100000:3.0:1783349833.222598:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642609152 00000100:00100000:3.0:1783349833.222653:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 288 00000100:00100000:3.0:1783349833.222662:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8709:x1869977642609152:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783349833.222826:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8709:x1869977642609152:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 165us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349833.222834:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 288 00000100:00100000:2.0:1783349833.274406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349833.274499:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642609280 00000100:00100000:0.0:1783349833.274510:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642609280 00000100:00100000:0.0:1783349833.274569:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 289 00000100:00100000:0.0:1783349833.274579:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8709:x1869977642609280:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783349833.274728:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8709:x1869977642609280:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 149us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349833.274736:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 289 00000100:00100000:2.0:1783349833.279461:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349833.279570:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642609408 00000100:00100000:1.0:1783349833.279580:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642609408 00000100:00100000:1.0:1783349833.279638:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 290 00000100:00100000:1.0:1783349833.279647:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8709:x1869977642609408:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349833.279794:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8709:x1869977642609408:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 146us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349833.279802:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 290 00000100:00100000:1.0:1783349833.283973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349833.284173:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642609536 00000100:00100000:3.0:1783349833.284184:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642609536 00000100:00100000:3.0:1783349833.284249:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 291 00000100:00100000:3.0:1783349833.284259:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:8705:x1869977642609536:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783349833.284276:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349833.284293:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e2156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decdd7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349833.284321:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e2156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdd7 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349833.284333:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e2156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdd7 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349833.284342:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea38215ee00, rc 0) 00000100:00100000:3.0:1783349833.284396:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:8705:x1869977642609536:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 139us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349833.284404:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 291 00000100:00100000:2.0:1783349833.290962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349833.297445:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642609664 00000100:00100000:0.0:1783349833.297462:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642609664 00000100:00100000:0.0:1783349833.297527:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 292 00000100:00100000:0.0:1783349833.297538:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:8705:x1869977642609664:12345-192.168.203.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783349833.297565:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783349833.297589:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783349833.297593:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783349833.297597:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783349833.297600:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783349833.297602:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1783349833.301708:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:8705:x1869977642609664:12345-192.168.203.50@tcp:256:mount.lustre.0 Request processed in 4161us (10744us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349833.301736:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 292 00000100:00100000:2.0:1783349833.306027:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349833.306179:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642609792 00000100:00100000:1.0:1783349833.306202:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642609792 00000100:00100000:1.0:1783349833.306267:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 293 00000100:00100000:1.0:1783349833.306277:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:8705:x1869977642609792:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783349833.306294:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349833.306309:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e215d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decdde expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349833.306337:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e215d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdde expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349833.306348:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e215d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdde expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349833.306357:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8ca00, rc 0) 00000100:00100000:1.0:1783349833.306414:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:8705:x1869977642609792:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 138us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349833.306421:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 293 00000100:00100000:2.0:1783349833.310228:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349833.310439:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642609920 00000100:00100000:0.0:1783349833.310449:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642609920 00000100:00100000:0.0:1783349833.310507:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 294 00000100:00100000:0.0:1783349833.310518:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:8705:x1869977642609920:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783349833.310677:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:8705:x1869977642609920:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 159us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349833.310686:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 294 00000100:00100000:2.0:1783349833.313794:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349833.313943:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642610048 00000100:00100000:3.0:1783349833.313954:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642610048 00000100:00100000:3.0:1783349833.314010:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 295 00000100:00100000:3.0:1783349833.314020:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:8705:x1869977642610048:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783349833.314224:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:8705:x1869977642610048:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 205us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349833.314246:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 295 00000100:00100000:2.0:1783349833.318254:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349833.319433:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642610176 00000100:00100000:1.0:1783349833.319446:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642610176 00000100:00100000:1.0:1783349833.319506:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 296 00000100:00100000:1.0:1783349833.319516:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:8714:x1869977642610176:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349833.319894:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:8714:x1869977642610176:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 377us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349833.319903:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 296 00000100:00100000:2.0:1783349833.326244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349833.326992:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642610304 00000100:00100000:0.0:1783349833.327013:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642610304 00000100:00100000:0.0:1783349833.327089:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 297 00000100:00100000:0.0:1783349833.327100:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:8714:x1869977642610304:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349833.327681:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:8714:x1869977642610304:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 580us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349833.327691:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 297 00000100:00100000:2.0:1783349833.334837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349833.334947:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349833.337558:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642610432 00000100:00100000:0.0:1783349833.337575:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642610432 00000100:00100000:2.0:1783349833.337713:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349833.337793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349833.337885:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642610688 00000100:00100000:0.0:1783349833.337889:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642610688 00000100:00100000:0.0:1783349833.337919:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642611072 00000100:00100000:0.0:1783349833.337922:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642611072 00000100:00100000:3.0:1783349833.337971:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642611200 00000100:00100000:3.0:1783349833.337975:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642611200 00000100:00080000:2.0:1783349833.338055:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783349833.338060:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349833.338101:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 112 00000100:00100000:0.0:1783349833.338114:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642611072:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349833.338211:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:2.0:1783349833.338218:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1869977642610688:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783349833.338242:0:8582:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1@192.168.203.50@tcp t0 exp 0000000000000000 cur 274 last 0 00000100:00100000:0.0:1783349833.338431:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642611072:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 319us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349833.338440:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 112 00000100:00100000:0.0:1783349833.338461:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:0.0:1783349833.338465:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1869977642610432:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783349833.338493:0:6518:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1@192.168.203.50@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:0.0:1783349833.338518:0:6518:0:(genops.c:1406:class_connect()) connect: client 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1, cookie 0xd05e6ae1590e216b 00000004:00100000:0.0:1783349833.338549:0:6518:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783349833.338657:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ea2434db000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349833.338689:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2398:x1869977642610432:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 221us (3861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349833.338696:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000020:00000080:2.0:1783349833.338865:0:8582:0:(genops.c:1406:class_connect()) connect: client 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1, cookie 0xd05e6ae1590e2164 00000004:00100000:2.0:1783349833.338880:0:8582:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783349833.338943:0:8582:0:(import.c:65:import_set_state_nolock()) ffff8ea243523800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783349833.338983:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2398:x1869977642610688:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 764us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349833.338990:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:2.0:1783349833.339500:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 113 00000100:00100000:2.0:1783349833.339510:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642611200:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349833.339550:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642611200:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 43us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349833.339557:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 113 00000100:00100000:2.0:1783349833.341008:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349833.342326:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642610816 00000100:00100000:3.0:1783349833.342339:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642610816 00000100:00100000:3.0:1783349833.342415:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1783349833.342434:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:0:x1869977642610816:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783349833.342470:0:8582:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783349833.342548:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:0:x1869977642610816:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 125us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349833.342729:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00080000:2.0:1783349833.342789:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783349833.343591:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349833.344077:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642610560 00000100:00100000:3.0:1783349833.344085:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642610560 00000100:00100000:3.0:1783349833.344177:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:3.0:1783349833.344187:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:0:x1869977642610560:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783349833.344219:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783349833.344286:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:0:x1869977642610560:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 99us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349833.344302:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00080000:2.0:1783349833.344787:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349833.349854:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349833.350217:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642610944 00000100:00100000:3.0:1783349833.350229:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642610944 00000100:00100000:3.0:1783349833.350301:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:3.0:1783349833.350312:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:8705:x1869977642610944:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783349833.350344:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783349833.350416:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:8705:x1869977642610944:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 105us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349833.350444:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00010000:00010000:0.0:1783349833.351571:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349833.357381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349833.359359:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642611328 00000100:00100000:1.0:1783349833.359374:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642611328 00000100:00100000:1.0:1783349833.359504:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:1.0:1783349833.359520:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:8705:x1869977642611328:12345-192.168.203.50@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783349833.359618:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:8705:x1869977642611328:12345-192.168.203.50@tcp:40:mount.lustre.0 Request processed in 101us (2246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349833.359626:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:2.0:1783349833.364534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349833.364577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349833.364677:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642611456 00000100:00100000:0.0:1783349833.364688:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642611456 00000100:00100000:0.0:1783349833.364733:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:0.0:1783349833.364740:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1869977642611456:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783349833.364769:0:8433:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1@192.168.203.50@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:0.0:1783349833.364798:0:8433:0:(genops.c:1406:class_connect()) connect: client 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1, cookie 0xd05e6ae1590e2172 00002000:00100000:0.0:1783349833.364811:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1/ffff8ea2434da000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783349833.364824:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783349833.364898:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783349833.364937:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8ea2434dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349833.365015:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2398:x1869977642611456:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 274us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349833.365023:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:3.0:1783349833.365573:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642611712 00000100:00100000:3.0:1783349833.365580:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642611712 00000100:00100000:2.0:1783349833.365743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349833.365798:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:3.0:1783349833.365808:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:8705:x1869977642611712:12345-192.168.203.50@tcp:900:mount.lustre.0 00000100:00100000:3.0:1783349833.365862:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:8705:x1869977642611712:12345-192.168.203.50@tcp:900:mount.lustre.0 Request processed in 56us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349833.365869:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:1.0:1783349833.365914:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642611584 00000100:00100000:1.0:1783349833.365918:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642611584 00000100:00100000:1.0:1783349833.365942:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:1.0:1783349833.365948:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1869977642611584:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783349833.365998:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1@192.168.203.50@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:1.0:1783349833.366020:0:8431:0:(genops.c:1406:class_connect()) connect: client 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1, cookie 0xd05e6ae1590e2179 00002000:00100000:1.0:1783349833.366032:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1/ffff8ea24321f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783349833.366048:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783349833.366117:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783349833.366167:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ea24321b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349833.366197:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2398:x1869977642611584:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 248us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349833.366204:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:2.0:1783349833.368441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349833.368573:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642611840 00000100:00100000:0.0:1783349833.368584:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642611840 00000100:00100000:0.0:1783349833.368639:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:0.0:1783349833.368673:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:8705:x1869977642611840:12345-192.168.203.50@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783349833.368762:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783349833.368842:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:8705:x1869977642611840:12345-192.168.203.50@tcp:33:mount.lustre.0 Request processed in 182us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349833.368849:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00010000:00010000:3.0:1783349834.373402:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349835.141750:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659457280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783349835.141823:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349835.141946:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659457280 00000100:00100000:1.0:1783349835.141954:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659457280 00000100:00100000:1.0:1783349835.142011:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783349835.142020:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659457280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783349835.142068:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783349835.144310:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659457280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2281us (2476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349835.144325:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783349835.147527:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659457280:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783349835.396945:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349836.424891:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349836.676440:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659457408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349836.676528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349836.676700:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659457408 00000100:00100000:0.0:1783349836.676708:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659457408 00000100:00100000:0.0:1783349836.676773:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783349836.676783:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659457408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783349836.676814:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349836.676868:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659457408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349836.676875:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783349836.676888:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659457536:0@lo:400:kworker.0 00010000:00080000:0.0:1783349836.676918:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36db7d880 x1869977659457408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349836.676931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349836.676939:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659457408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349836.677436:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659458048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349836.677470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349836.677543:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659457792:0@lo:400:kworker.0 00000100:00100000:2.0:1783349836.677571:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349836.677593:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659458304:0@lo:400:kworker.0 00000100:00100000:2.0:1783349836.677622:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783349836.677633:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349836.677643:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659458816:0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.677654:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659457664:0@lo:400:kworker.0 00000100:00100000:2.0:1783349836.677675:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349836.677682:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659457920:0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.677758:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349836.677776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349836.677787:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659458176:0@lo:400:kworker.0 00000100:00100000:2.0:1783349836.677788:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659458304 00000100:00100000:2.0:1783349836.677796:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659458304 00000100:00100000:0.0:1783349836.677800:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659458432:0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.677825:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349836.677832:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349836.677834:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659458816 00000100:00100000:2.0:1783349836.677837:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659458816 00000100:00100000:0.0:1783349836.677849:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659458944:0@lo:400:kworker.0 00000100:00100000:2.0:1783349836.677854:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659457664 00000100:00100000:3.0:1783349836.677857:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659458688:0@lo:400:kworker.0 00000100:00100000:2.0:1783349836.677858:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659457664 00000100:00100000:0.0:1783349836.677870:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349836.677874:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659457920 00000100:00100000:2.0:1783349836.677884:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659457920 00000100:00100000:0.0:1783349836.677887:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783349836.677893:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659458560:0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.677898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349836.677900:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659458432 00000100:00100000:2.0:1783349836.677903:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659458432 00000100:00100000:2.0:1783349836.677921:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659458944 00000100:00100000:2.0:1783349836.677923:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659458944 00000100:00100000:0.0:1783349836.677930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349836.677944:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783349836.677952:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659458304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349836.677952:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659459072:0@lo:400:kworker.0 00000100:00100000:0.0:1783349836.677976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349836.677992:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659457792 00000100:00100000:2.0:1783349836.677995:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659458304:12345-0@lo:400:kworker.0 Request processed in 44us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349836.677999:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659457792 00000100:00100000:2.0:1783349836.678006:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783349836.678010:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783349836.678041:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659458176 00000100:00100000:3.0:1783349836.678054:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659458176 00000100:00100000:3.0:1783349836.678073:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783349836.678081:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659457792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349836.678089:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659458816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.678117:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659457792:12345-0@lo:400:kworker.0 Request processed in 36us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349836.678123:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783349836.678174:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783349836.678181:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783349836.678187:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659458176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349836.678193:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659457664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349836.678212:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659458816:12345-0@lo:400:kworker.0 Request processed in 195us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349836.678218:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783349836.678234:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783349836.678247:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659458176:12345-0@lo:400:kworker.0 Request processed in 58us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349836.678247:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659457920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.678261:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783349836.678284:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783349836.678290:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659457920:12345-0@lo:400:kworker.0 Request processed in 48us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349836.678294:0:6518:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1783349836.678301:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783349836.678319:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783349836.678321:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659457664:12345-0@lo:400:kworker.0 Request processed in 55us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349836.678328:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783349836.678331:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659458432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349836.678340:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659458944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.678380:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659458432:12345-0@lo:400:kworker.0 Request processed in 51us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349836.678387:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659458944:12345-0@lo:400:kworker.0 Request processed in 50us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349836.678390:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659457536 00000100:00100000:1.0:1783349836.678394:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659457536 00000100:00100000:1.0:1783349836.678416:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1783349836.678421:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659457536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349836.678449:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659457536:12345-0@lo:400:kworker.0 Request processed in 28us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349836.678455:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1783349836.678490:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659457536:0@lo:400:kworker.0 00000100:00100000:2.0:1783349836.678551:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783349836.678637:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783349836.678644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1783349836.678660:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349836.678665:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349836.678672:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659458688 00000100:00100000:0.0:1783349836.678676:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659458688 00000100:00100000:3.0:1783349836.678682:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659458560 00000100:00100000:3.0:1783349836.678687:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659458560 00000100:00080000:2.0:1783349836.678833:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349836.678864:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659459072 00000100:00100000:0.0:1783349836.678869:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659459072 00000100:00100000:0.0:1783349836.678898:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349836.678904:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659458688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349836.678932:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783349836.678940:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659458560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349836.678940:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659458688:12345-0@lo:400:kworker.0 Request processed in 36us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349836.678955:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349836.678966:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783349836.678967:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659458560:12345-0@lo:400:kworker.0 Request processed in 29us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349836.678971:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659459072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349836.678972:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783349836.679002:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659459072:12345-0@lo:400:kworker.0 Request processed in 31us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349836.679008:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1783349836.679038:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349836.679232:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659459200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349836.679268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349836.679303:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659457664:0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.679314:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659458176:0@lo:400:kworker.0 00010000:00080000:0.0:1783349836.679317:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f539180 x1869977659458560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783349836.679325:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f538e00 x1869977659458688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349836.679336:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659458560:0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.679343:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659458688:0@lo:400:kworker.0 00010000:00080000:0.0:1783349836.679358:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f53ad80 x1869977659459072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349836.679368:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659459072:0@lo:400:kworker.0 00000100:00100000:0.0:1783349836.679382:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659457920:0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.679388:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659458048 00000100:00100000:2.0:1783349836.679390:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659459200 00010000:00080000:0.0:1783349836.679393:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f53a300 x1869977659458432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349836.679394:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659458048 00000100:00100000:2.0:1783349836.679396:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659459200 00000100:00100000:0.0:1783349836.679404:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659458432:0@lo:400:kworker.0 00010000:00080000:0.0:1783349836.679415:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f539500 x1869977659458944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349836.679424:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659458944:0@lo:400:kworker.0 00000100:00100000:2.0:1783349836.679432:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783349836.679438:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659459200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783349836.679462:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349836.679624:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659459200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 185us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349836.679631:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783349836.679659:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659459200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349836.679661:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659457792:0@lo:400:kworker.0 00000100:00100000:2.0:1783349836.679673:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659458304:0@lo:400:kworker.0 00000100:00100000:3.0:1783349836.679706:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783349836.679726:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659458048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349836.679742:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349836.679828:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659458048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (2357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349836.679835:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783349836.679900:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659458816:0@lo:400:kworker.0 00010000:00080000:1.0:1783349836.679919:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36db7d880 x1869977659458048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349836.679934:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659458048:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783349837.444471:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349838.212632:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659459328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349838.212706:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349838.212841:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659459328 00000100:00100000:1.0:1783349838.212863:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659459328 00000100:00100000:1.0:1783349838.212927:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783349838.212939:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659459328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783349838.212973:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349838.213042:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659459328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349838.213051:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1783349838.213121:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783349838.213169:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243047800 x1869977659459328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349838.213188:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659459328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349838.213396:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349838.213407:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659459456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349838.213445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349838.213550:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659459456 00000100:00100000:3.0:1783349838.213555:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659459456 00000100:00100000:3.0:1783349838.213602:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783349838.213610:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659459456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783349838.213627:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349838.213663:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659459456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349838.213669:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1783349838.213694:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f538000 x1869977659459456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349838.213707:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659459456:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783349838.213760:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349838.423541:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349838.423584:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349838.423607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349838.423625:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349838.423643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349838.423661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349838.423697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349838.423722:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642612224 00000100:00100000:2.0:1783349838.423731:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642612224 00000100:00100000:2.0:1783349838.423784:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642612480 00000100:00100000:2.0:1783349838.423787:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642612480 00000100:00100000:2.0:1783349838.423801:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642612096 00000100:00100000:2.0:1783349838.423803:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642612096 00000100:00100000:2.0:1783349838.423812:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642612352 00000100:00100000:2.0:1783349838.423814:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642612352 00000100:00100000:2.0:1783349838.423828:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:2.0:1783349838.423837:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642612224:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349838.423907:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642612224:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 70us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.423927:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:2.0:1783349838.423942:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:2.0:1783349838.423948:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2400:x1869977642612480:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349838.423972:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2400:x1869977642612480:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.423977:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:2.0:1783349838.423986:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:2.0:1783349838.423991:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642612096:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349838.424024:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642612096:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.424038:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:2.0:1783349838.424049:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:2.0:1783349838.424055:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2400:x1869977642612352:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349838.424075:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2400:x1869977642612352:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 20us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.424081:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:2.0:1783349838.424096:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642612736 00000100:00100000:2.0:1783349838.424099:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642612736 00000100:00100000:2.0:1783349838.424121:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642612608 00000100:00100000:2.0:1783349838.424123:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642612608 00000100:00100000:2.0:1783349838.424174:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:2.0:1783349838.424181:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2400:x1869977642612736:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349838.424207:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2400:x1869977642612736:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 27us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.424218:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:2.0:1783349838.424231:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:2.0:1783349838.424237:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2400:x1869977642612608:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349838.424260:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2400:x1869977642612608:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 24us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.424266:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00080000:2.0:1783349838.424287:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349838.424291:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349838.424294:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349838.424295:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783349838.424472:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642611968 00000100:00100000:3.0:1783349838.424477:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642611968 00000100:00100000:3.0:1783349838.424513:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 299 00000100:00100000:3.0:1783349838.424520:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642611968:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349838.424603:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642611968:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 83us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349838.424610:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 299 00000001:02000400:1.0:1783349838.453712:0:12184:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1783349838.468455:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783349839.252731:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000001:00100000:0.0:1783349839.254634:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000001:00100000:1.0:1783349839.255241:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000001:00100000:2.0:1783349839.257487:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00010000:00010000:0.0:1783349839.493464:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349840.262894:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659459584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349840.262956:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349840.263179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659459584 00000100:00100000:3.0:1783349840.263196:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659459584 00000100:00100000:3.0:1783349840.263241:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783349840.263249:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659459584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783349840.263280:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783349840.263332:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659459584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349840.263338:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783349840.263471:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659459584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783349840.516365:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349841.541292:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349841.796403:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349841.796430:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659459712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349841.796508:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349841.796721:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659459712 00000100:00100000:0.0:1783349841.796730:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659459712 00000100:00100000:0.0:1783349841.796791:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783349841.796801:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659459712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349841.796827:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349841.796874:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659459712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349841.796881:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1783349841.796918:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243764a80 x1869977659459712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349841.796935:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659459712:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783349841.797026:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349841.797306:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349841.797316:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659459968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349841.797400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349841.797437:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659459968 00000100:00100000:3.0:1783349841.797440:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659459968 00000100:00100000:3.0:1783349841.797469:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783349841.797476:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659459968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783349841.797511:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783349841.797546:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659459968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349841.797553:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783349841.797573:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349841.797582:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659459840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349841.797607:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349841.797763:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659459840 00000100:00100000:3.0:1783349841.797767:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659459840 00000100:00100000:3.0:1783349841.797798:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783349841.797805:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659459840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783349841.797829:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349841.797860:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659459840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349841.797867:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1783349841.797881:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783349841.797900:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243764a80 x1869977659459840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349841.797914:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659459840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349841.797941:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659459968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349841.799537:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659460096:0@lo:400:kworker.0 00000100:00100000:0.0:1783349841.799588:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349841.799749:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349841.799756:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659460480:0@lo:400:kworker.0 00000100:00100000:0.0:1783349841.799783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349841.799812:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659460480 00000100:00100000:0.0:1783349841.799818:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659460480 00000100:00100000:0.0:1783349841.799853:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783349841.799860:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659460480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349841.799909:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659460480:12345-0@lo:400:kworker.0 Request processed in 49us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349841.799916:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783349841.799950:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659460480:0@lo:400:kworker.0 00000100:00100000:0.0:1783349841.802050:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659460608:0@lo:400:kworker.0 00000100:00100000:0.0:1783349841.802118:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349841.802197:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659460096 00000100:00100000:2.0:1783349841.802204:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659460096 00000100:00100000:2.0:1783349841.802249:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1783349841.802257:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659460096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349841.802454:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659460608 00000100:00100000:1.0:1783349841.802458:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659460608 00000100:00100000:2.0:1783349841.802574:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659460096:12345-0@lo:400:kworker.0 Request processed in 316us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349841.802581:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1783349841.802624:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659460992:0@lo:400:kworker.0 00000100:00100000:2.0:1783349841.802652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349841.802681:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659460992 00000100:00100000:2.0:1783349841.802685:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659460992 00000100:00100000:2.0:1783349841.802713:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783349841.802720:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659460992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349841.802755:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659460992:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349841.802772:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1783349841.802808:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243046680 x1869977659460992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349841.802821:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659460992:0@lo:400:kworker.0 00000100:00100000:1.0:1783349841.802948:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783349841.802957:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659460608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349841.802996:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659460608:12345-0@lo:400:kworker.0 Request processed in 42us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.803002:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1783349841.803030:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783349841.803034:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349841.803105:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659460224:0@lo:400:kworker.0 00000100:00100000:3.0:1783349841.803132:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349841.803173:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659460736:0@lo:400:kworker.0 00000100:00100000:3.0:1783349841.803203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349841.803219:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659461248:0@lo:400:kworker.0 00000100:00100000:3.0:1783349841.803236:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349841.803251:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783349841.803256:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659460352:0@lo:400:kworker.0 00000100:00100000:3.0:1783349841.803273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349841.803286:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659460864:0@lo:400:kworker.0 00000100:00100000:3.0:1783349841.803301:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349841.803322:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659460224 00000100:00100000:3.0:1783349841.803326:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659460224 00000100:00100000:3.0:1783349841.803343:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659460736 00000100:00100000:3.0:1783349841.803345:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659460736 00000100:00100000:3.0:1783349841.803356:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659461248 00000100:00100000:3.0:1783349841.803362:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659461248 00000100:00100000:3.0:1783349841.803377:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783349841.803382:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659460224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349841.803411:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659460224:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349841.803416:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783349841.803427:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783349841.803432:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659460736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349841.803450:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659460736:12345-0@lo:400:kworker.0 Request processed in 19us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349841.803456:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783349841.803463:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783349841.803468:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659461248:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783349841.803580:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783349841.803585:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349841.803598:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659461120:0@lo:400:kworker.0 00000100:00100000:1.0:1783349841.803682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349841.803703:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659461120 00000100:00100000:1.0:1783349841.803706:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659461120 00000100:00100000:1.0:1783349841.803731:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783349841.803737:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659461120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349841.803768:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659461120:12345-0@lo:400:kworker.0 Request processed in 32us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.803773:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1783349841.803787:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349841.803805:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659461120:0@lo:400:kworker.0 00000100:00100000:0.0:1783349841.803914:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659460096:0@lo:400:kworker.0 00000100:00100000:0.0:1783349841.803931:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659460608:0@lo:400:kworker.0 00000100:00100000:1.0:1783349841.804241:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659460352 00000100:00100000:1.0:1783349841.804246:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659460352 00000100:00100000:1.0:1783349841.804277:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783349841.804283:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659460352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349841.804318:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659460352:12345-0@lo:400:kworker.0 Request processed in 35us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.804323:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783349841.810331:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659461248:12345-0@lo:400:kworker.0 Request processed in 17us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349841.810356:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783349841.810402:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659460864 00000100:00100000:3.0:1783349841.810411:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659460864 00000100:00100000:3.0:1783349841.810599:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783349841.810608:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659460864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349841.810701:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659460864:12345-0@lo:400:kworker.0 Request processed in 94us (7398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349841.810708:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783349841.810750:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659460352:0@lo:400:kworker.0 00010000:00080000:3.0:1783349841.810764:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243044e00 x1869977659460864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349841.810789:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659460864:0@lo:400:kworker.0 00000100:00100000:3.0:1783349841.810804:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659460224:0@lo:400:kworker.0 00010000:00080000:3.0:1783349841.810815:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243047100 x1869977659460736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349841.810824:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659460736:0@lo:400:kworker.0 00010000:00080000:3.0:1783349841.810834:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243044a80 x1869977659461248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349841.810842:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659461248:0@lo:400:kworker.0 00000100:00080000:0.0:1783349841.813403:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783349842.564476:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349843.332876:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349843.332899:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659461376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349843.332986:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349843.333115:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659461376 00000100:00100000:3.0:1783349843.333123:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659461376 00000100:00100000:3.0:1783349843.333207:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1783349843.333340:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349843.334387:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659461376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783349843.334429:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349843.334622:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349843.334639:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659461504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349843.337915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349843.338430:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659461504 00000100:00100000:0.0:1783349843.338440:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659461504 00000100:00100000:0.0:1783349843.338513:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783349843.338522:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659461504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349843.338549:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349843.338603:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659461504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349843.338611:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1783349843.338643:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783349843.338885:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f539500 x1869977659461504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349843.338907:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659461504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349843.342616:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659461376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9391us (9619us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349843.342631:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1783349843.349590:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b2ce00 x1869977659461376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349843.349621:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659461376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349843.543596:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349843.543637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349843.543697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349843.543730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349843.543750:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349843.543768:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349843.543791:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349843.543821:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642613504 00000100:00100000:2.0:1783349843.543833:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642613504 00000100:00100000:1.0:1783349843.543963:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642612992 00000100:00100000:1.0:1783349843.543967:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642612992 00000100:00100000:1.0:1783349843.544028:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642613248 00000100:00100000:1.0:1783349843.544041:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642613248 00000100:00100000:1.0:1783349843.544058:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642613120 00000100:00100000:1.0:1783349843.544060:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642613120 00000100:00100000:1.0:1783349843.544071:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642613376 00000100:00100000:1.0:1783349843.544074:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642613376 00000100:00100000:1.0:1783349843.544092:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:1.0:1783349843.544111:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642612992:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349843.544222:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642612992:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 111us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349843.544230:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:1.0:1783349843.544249:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 131 00000100:00100000:1.0:1783349843.544255:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642613248:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349843.544281:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642613248:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349843.544287:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 131 00000100:00100000:1.0:1783349843.544298:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 132 00000100:00100000:1.0:1783349843.544304:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642613120:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349843.544345:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642613120:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 40us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349843.544351:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 132 00000100:00100000:1.0:1783349843.544363:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:1.0:1783349843.544370:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642613376:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349843.544392:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642613376:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349843.544398:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00080000:0.0:1783349843.544745:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349843.544750:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349843.548128:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642613632 00000100:00100000:2.0:1783349843.548157:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642613632 00000100:00080000:0.0:1783349843.550113:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349843.550591:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349843.551964:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:1.0:1783349843.552002:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642613504:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349843.552108:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642613504:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 130us (8408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349843.552158:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:2.0:1783349843.553265:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:2.0:1783349843.553288:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642613632:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349843.553571:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642613632:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 287us (9777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349843.553579:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:2.0:1783349843.553602:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642612864 00000100:00100000:2.0:1783349843.553609:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642612864 00000100:00100000:2.0:1783349843.553640:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 301 00000100:00100000:2.0:1783349843.553646:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642612864:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349843.553669:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642612864:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (9938us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349843.553676:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 301 00010000:00010000:3.0:1783349843.588297:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349844.612394:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349845.390689:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349845.390716:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659461632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349845.390795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349845.390956:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659461632 00000100:00100000:3.0:1783349845.390966:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659461632 00000100:00100000:3.0:1783349845.391153:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783349845.391171:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659461632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783349845.391208:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783349845.391281:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659461632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349845.391288:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783349845.391519:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659461632:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1783349845.436291:0:12500:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783349845.436604:0:12500:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783349845.636296:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349846.663735:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349846.916366:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349846.916431:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659461760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349846.916510:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349846.916621:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659461760 00000100:00100000:0.0:1783349846.916630:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659461760 00000100:00100000:0.0:1783349846.918432:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783349846.918448:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659461760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349846.918479:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349846.918553:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659461760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349846.918559:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783349846.918612:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659462016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349846.918644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349846.921084:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659462144:0@lo:400:kworker.0 00000100:00100000:2.0:1783349846.921203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349846.921277:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659462144 00000100:00100000:2.0:1783349846.921285:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659462144 00000100:00100000:2.0:1783349846.921334:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1783349846.921343:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659462144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349846.921397:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659462144:12345-0@lo:400:kworker.0 Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349846.921405:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1783349846.921436:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349846.921446:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659461888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349846.921494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349846.921527:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659461888 00000100:00100000:2.0:1783349846.921537:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659461888 00000100:00100000:2.0:1783349846.921565:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783349846.921571:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659461888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783349846.921598:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349846.921635:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659461888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349846.921642:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783349846.921681:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659461888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349846.921706:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659462144:0@lo:400:kworker.0 00000100:00100000:3.0:1783349846.921840:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659462016 00000100:00100000:3.0:1783349846.921845:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659462016 00000100:00080000:1.0:1783349846.922077:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783349846.922114:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da4e00 x1869977659461760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349846.922132:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659461760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349846.925398:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659462528:0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.925471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349846.925501:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659463040:0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.925526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349846.925550:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783349846.925556:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659462656:0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.925576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349846.925594:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659463168:0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.925613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349846.925637:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659462272:0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.925671:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349846.925690:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659462784:0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.925707:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349846.925721:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659463296:0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.925751:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349846.925762:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783349846.925767:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659462400:0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.925786:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349846.925802:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659462912:0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.925819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349846.925850:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659463040 00000100:00100000:0.0:1783349846.925857:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659463040 00000100:00100000:0.0:1783349846.925905:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659462912 00000100:00100000:0.0:1783349846.925908:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659462912 00000100:00100000:0.0:1783349846.925930:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783349846.925939:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659463040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349846.926533:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783349846.926542:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659462016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783349846.926562:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349846.926613:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659462016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (7968us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349846.926620:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1783349846.926663:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370df4a80 x1869977659462016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349846.926680:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659462016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349846.926744:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659462528 00000100:00100000:1.0:1783349846.926749:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659462528 00000100:00100000:1.0:1783349846.926771:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659462656 00000100:00100000:1.0:1783349846.926774:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659462656 00000100:00100000:1.0:1783349846.926787:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659463168 00000100:00100000:1.0:1783349846.926790:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659463168 00000100:00100000:1.0:1783349846.926801:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659462272 00000100:00100000:1.0:1783349846.926803:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659462272 00000100:00100000:1.0:1783349846.926812:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659462784 00000100:00100000:1.0:1783349846.926814:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659462784 00000100:00100000:1.0:1783349846.926825:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659463296 00000100:00100000:1.0:1783349846.926827:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659463296 00000100:00100000:1.0:1783349846.926841:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783349846.926847:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659462528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349846.927289:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659462528:12345-0@lo:400:kworker.0 Request processed in 441us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349846.927297:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783349846.927312:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783349846.927326:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659462656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349846.927358:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659462656:12345-0@lo:400:kworker.0 Request processed in 34us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349846.927364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783349846.927376:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783349846.927381:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659463168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349846.927408:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659463168:12345-0@lo:400:kworker.0 Request processed in 27us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349846.927414:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783349846.927425:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783349846.927430:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659462272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349846.927466:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659462272:12345-0@lo:400:kworker.0 Request processed in 35us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349846.927472:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783349846.927482:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783349846.927488:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659462784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349846.927516:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659462784:12345-0@lo:400:kworker.0 Request processed in 28us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349846.927521:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783349846.927532:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783349846.927538:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659463296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349846.927567:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659463296:12345-0@lo:400:kworker.0 Request processed in 29us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349846.927572:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783349846.927606:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659462272:0@lo:400:kworker.0 00010000:00080000:1.0:1783349846.927629:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a04a80 x1869977659462784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349846.927640:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659462784:0@lo:400:kworker.0 00010000:00080000:1.0:1783349846.927650:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a07100 x1869977659463296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349846.927659:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659463296:0@lo:400:kworker.0 00000100:00080000:1.0:1783349846.927689:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783349846.927693:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349846.927696:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349846.927808:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659463040:12345-0@lo:400:kworker.0 Request processed in 1868us (2278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349846.927817:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783349846.927834:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783349846.927841:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659462912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.927878:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659462912:12345-0@lo:400:kworker.0 Request processed in 38us (2057us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349846.927884:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783349846.927917:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659462400 00000100:00100000:0.0:1783349846.927921:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659462400 00000100:00100000:0.0:1783349846.927950:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783349846.927956:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659462400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349846.927997:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659462400:12345-0@lo:400:kworker.0 Request processed in 40us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349846.928003:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783349846.928310:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659462656:0@lo:400:kworker.0 00000100:00100000:3.0:1783349846.928323:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659463168:0@lo:400:kworker.0 00000100:00100000:3.0:1783349846.928334:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659462528:0@lo:400:kworker.0 00010000:00080000:3.0:1783349846.928347:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a04380 x1869977659463040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349846.928356:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659463040:0@lo:400:kworker.0 00000100:00100000:1.0:1783349846.929322:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659462400:0@lo:400:kworker.0 00010000:00080000:1.0:1783349846.929337:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a07480 x1869977659462912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349846.929346:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659462912:0@lo:400:kworker.0 00000020:00000004:2.0:1783349847.319360:0:12598:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783349847.319648:0:12598:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783349847.687639:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349848.460446:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783349848.460471:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659463424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349848.460474:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659463552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349848.464030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349848.464260:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349848.464293:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659463552 00000100:00100000:3.0:1783349848.464301:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659463552 00000100:00100000:3.0:1783349848.464353:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659463424 00000100:00100000:3.0:1783349848.464356:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659463424 00000100:00100000:3.0:1783349848.464373:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783349848.464380:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659463552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783349848.464411:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349848.464455:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659463552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349848.464463:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783349848.464477:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783349848.464483:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659463424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783349848.464493:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349848.464519:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659463424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349848.464526:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1783349848.464556:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b2ca80 x1869977659463552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349848.464575:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659463552:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1783349848.464604:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a04e00 x1869977659463424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349848.464616:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659463424:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783349848.464634:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349848.670628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349848.670713:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349848.673093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349848.673124:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349848.673172:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349848.673453:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642613888 00000100:00100000:3.0:1783349848.673463:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642613888 00000100:00100000:3.0:1783349848.673518:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642614144 00000100:00100000:3.0:1783349848.673522:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642614144 00000100:00100000:3.0:1783349848.673547:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 140 00000100:00100000:3.0:1783349848.673556:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642613888:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349848.673630:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642613888:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 75us (3011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349848.673638:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 140 00000100:00100000:3.0:1783349848.673656:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 141 00000100:00100000:3.0:1783349848.673663:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642614144:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349848.673689:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642614144:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 28us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349848.673696:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 141 00000100:00080000:3.0:1783349848.673714:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349848.675068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349848.675101:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349848.675131:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642614400 00000100:00100000:3.0:1783349848.675494:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642614016 00000100:00100000:3.0:1783349848.675504:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642614016 00000100:00100000:3.0:1783349848.675550:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642614272 00000100:00100000:3.0:1783349848.675553:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642614272 00000100:00100000:3.0:1783349848.675574:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:3.0:1783349848.675583:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642614016:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349848.675644:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642614016:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 61us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349848.675651:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:3.0:1783349848.675667:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 143 00000100:00100000:3.0:1783349848.675673:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642614272:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349848.675714:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642614272:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 41us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349848.675720:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 143 00000100:00080000:3.0:1783349848.675742:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783349848.675806:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642614400 00000100:00100000:1.0:1783349848.675841:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642614528 00000100:00100000:1.0:1783349848.675844:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642614528 00000100:00100000:1.0:1783349848.675866:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:1.0:1783349848.675879:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642614400:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349848.675907:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642614400:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 29us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349848.675914:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:1.0:1783349848.675926:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:1.0:1783349848.675943:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642614528:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349848.675978:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642614528:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 47us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349848.675984:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:1.0:1783349848.676002:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642613760 00000100:00100000:1.0:1783349848.676005:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642613760 00000100:00100000:1.0:1783349848.676031:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 303 00000100:00100000:1.0:1783349848.676037:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2401:x1869977642613760:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349848.676060:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2401:x1869977642613760:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (2936us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349848.676066:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 303 00000100:00080000:3.0:1783349848.677065:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349848.677071:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783349848.711361:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783349849.191604:0:12695:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783349849.191832:0:12695:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783349849.735187:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349850.502772:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659463680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349850.502846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349850.503101:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659463680 00000100:00100000:3.0:1783349850.503111:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659463680 00000100:00100000:3.0:1783349850.503197:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783349850.503208:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659463680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783349850.503244:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783349850.503298:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659463680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349850.503305:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783349850.503693:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659463680:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783349850.756548:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783349851.089778:0:12792:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783349851.090011:0:12792:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783349851.780400:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349852.036695:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659463808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349852.036772:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349852.036835:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783349852.036846:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659463936:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.036888:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349852.036924:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659464320:0@lo:400:kworker.0 00000100:00100000:2.0:1783349852.036968:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659464064:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.036969:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349852.036992:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659464832:0@lo:400:kworker.0 00000100:00100000:2.0:1783349852.037011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349852.037025:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349852.037039:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659464576:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037052:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659465344:0@lo:400:kworker.0 00000100:00100000:2.0:1783349852.037068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349852.037085:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349852.037092:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659465088:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037110:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783349852.037120:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659464448:0@lo:400:kworker.0 00000100:00100000:2.0:1783349852.037121:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349852.037168:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783349852.037172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349852.037178:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659464192:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037194:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659464960:0@lo:400:kworker.0 00000100:00100000:2.0:1783349852.037208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349852.037224:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349852.037233:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659464704:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037258:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659463808 00000100:00100000:0.0:1783349852.037266:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659463808 00000100:00100000:2.0:1783349852.037281:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349852.037303:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659465216:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037311:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659464192 00000100:00100000:0.0:1783349852.037316:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659464192 00000100:00100000:2.0:1783349852.037342:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349852.037353:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783349852.037363:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659463808:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349852.037371:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659464320 00000100:00100000:2.0:1783349852.037376:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659464320 00000100:00100000:2.0:1783349852.037400:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659464064 00000100:00100000:2.0:1783349852.037402:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659464064 00000004:00000024:0.0:1783349852.037405:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349852.037415:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659464576 00000100:00100000:2.0:1783349852.037419:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659464576 00000100:00100000:2.0:1783349852.037445:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659465088 00000100:00100000:2.0:1783349852.037448:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659465088 00000100:00100000:0.0:1783349852.037459:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659463808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349852.037465:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659464448 00000100:00100000:0.0:1783349852.037468:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783349852.037470:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659464448 00000100:00100000:2.0:1783349852.037489:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659464960 00000100:00100000:2.0:1783349852.037492:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659464960 00000100:00100000:0.0:1783349852.037496:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783349852.037505:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659464192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349852.037516:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783349852.037526:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659464320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037548:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659464192:12345-0@lo:400:kworker.0 Request processed in 44us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349852.037556:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783349852.037578:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659464320:12345-0@lo:400:kworker.0 Request processed in 54us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349852.037586:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783349852.037592:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659463936 00000100:00100000:0.0:1783349852.037597:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659463936 00000100:00100000:2.0:1783349852.037605:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783349852.037614:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659464064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037626:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1783349852.037635:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659463936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349852.037645:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659464064:12345-0@lo:400:kworker.0 Request processed in 32us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349852.037652:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783349852.037668:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783349852.037675:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659463936:12345-0@lo:400:kworker.0 Request processed in 42us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349852.037677:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659464576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037689:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1783349852.037719:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659464576:12345-0@lo:400:kworker.0 Request processed in 44us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349852.037726:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783349852.037734:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659465088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037764:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659465088:12345-0@lo:400:kworker.0 Request processed in 31us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349852.037770:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783349852.037781:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783349852.037786:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659464448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037811:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659464448:12345-0@lo:400:kworker.0 Request processed in 25us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349852.037827:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783349852.037840:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783349852.037845:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659464960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037872:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659464960:12345-0@lo:400:kworker.0 Request processed in 27us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349852.037877:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783349852.037893:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659464832 00000100:00100000:0.0:1783349852.037896:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659464832 00000100:00100000:0.0:1783349852.037912:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659465344 00000100:00100000:0.0:1783349852.037915:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659465344 00000100:00100000:0.0:1783349852.037936:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659464704 00000100:00100000:0.0:1783349852.037940:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659464704 00000100:00100000:0.0:1783349852.037951:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659465216 00000100:00100000:0.0:1783349852.037953:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659465216 00000100:00100000:0.0:1783349852.037964:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783349852.037969:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659464832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.037997:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659464832:12345-0@lo:400:kworker.0 Request processed in 27us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349852.038002:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783349852.038011:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783349852.038016:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659465344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.038038:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659465344:12345-0@lo:400:kworker.0 Request processed in 22us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349852.038050:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783349852.038054:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783349852.038063:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783349852.038071:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659464704:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783349852.038089:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349852.038095:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349852.038098:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349852.038100:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349852.038114:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659464704:12345-0@lo:400:kworker.0 Request processed in 43us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349852.038120:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783349852.038132:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783349852.038157:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659465216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.038183:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659465216:12345-0@lo:400:kworker.0 Request processed in 46us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349852.038188:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783349852.038235:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659464192:0@lo:400:kworker.0 00010000:00080000:0.0:1783349852.038251:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a0d180 x1869977659464704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349852.038262:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659464704:0@lo:400:kworker.0 00010000:00080000:0.0:1783349852.038274:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a0ed80 x1869977659465216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349852.038283:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659465216:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.038294:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659464064:0@lo:400:kworker.0 00010000:00080000:0.0:1783349852.038306:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a0e300 x1869977659464576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349852.038315:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659464576:0@lo:400:kworker.0 00010000:00080000:0.0:1783349852.038324:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a0d500 x1869977659465088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349852.038331:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659465088:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.038387:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659464448:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.038396:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659464960:0@lo:400:kworker.0 00010000:00080000:0.0:1783349852.038405:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a0ca80 x1869977659465344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349852.038413:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659465344:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.038422:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659464320:0@lo:400:kworker.0 00010000:00080000:0.0:1783349852.038430:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a0ce00 x1869977659464832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349852.038439:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659464832:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.038446:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659463936:0@lo:400:kworker.0 00000100:00100000:0.0:1783349852.038460:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659463808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783349852.039380:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659465472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349852.039437:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349852.040254:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659465472 00000100:00100000:3.0:1783349852.040262:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659465472 00000100:00100000:3.0:1783349852.040305:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783349852.040314:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659465472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783349852.040342:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349852.040362:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783349852.040377:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659465600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349852.040400:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659465472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349852.040408:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783349852.040418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349852.049678:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659465600 00000100:00100000:3.0:1783349852.049696:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659465600 00000100:00100000:3.0:1783349852.049760:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783349852.049772:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659465600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349852.049813:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349852.050134:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659465600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 363us (9715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349852.050162:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1783349852.050212:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a1bb80 x1869977659465472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349852.050234:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659465472:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1783349852.050270:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b2dc00 x1869977659465600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349852.050282:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659465600:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783349852.804565:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783349853.001077:0:12889:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783349853.001517:0:12889:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783349853.575763:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659465728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349853.575832:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349853.575924:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659465728 00000100:00100000:1.0:1783349853.575932:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659465728 00000100:00100000:1.0:1783349853.575992:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783349853.576000:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659465728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783349853.576041:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349853.576633:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659465856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349853.576667:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349853.576703:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659465856 00000100:00100000:0.0:1783349853.576708:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659465856 00000100:00100000:0.0:1783349853.576728:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783349853.576734:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659465856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349853.576747:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349853.576779:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659465856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349853.576786:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1783349853.576820:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a07100 x1869977659465856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349853.576846:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659465856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349853.582456:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659465728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6447us (6614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349853.582471:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1783349853.584716:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da4e00 x1869977659465728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349853.584742:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659465728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349853.783241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349853.783278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349853.783294:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642614784 00000100:00100000:0.0:1783349853.783303:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642614784 00000100:00100000:3.0:1783349853.783308:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349853.783328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349853.783343:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349853.786787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349853.786820:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349853.786857:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642614656 00000100:00100000:3.0:1783349853.786868:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642614656 00000100:00100000:3.0:1783349853.787131:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 305 00000100:00100000:3.0:1783349853.787240:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642614656:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349853.787310:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642614656:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 73us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349853.787317:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 305 00000100:00100000:2.0:1783349853.788204:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642615296 00000100:00100000:2.0:1783349853.788214:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642615296 00000100:00100000:0.0:1783349853.788255:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642615040 00000100:00100000:2.0:1783349853.788260:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642615424 00000100:00100000:0.0:1783349853.788262:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642615040 00000100:00100000:2.0:1783349853.788265:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642615424 00000100:00100000:2.0:1783349853.788297:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:2.0:1783349853.788308:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2398:x1869977642615296:12345-192.168.203.50@tcp:9:kworker.0 00000100:00100000:0.0:1783349853.788312:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642614912 00000100:00100000:0.0:1783349853.788317:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642614912 00000020:00000080:2.0:1783349853.788333:0:8433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2172 00000100:00100000:0.0:1783349853.788336:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642615168 00000100:00100000:0.0:1783349853.788340:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642615168 00000100:00080000:2.0:1783349853.788343:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8ea2434dc800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783349853.788361:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 150 00000100:00100000:0.0:1783349853.788370:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642614784:12345-192.168.203.50@tcp:400:kworker.0 00000001:00000004:2.0:1783349853.788391:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1783349853.788421:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642614784:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 52us (5188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349853.788428:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 150 00000100:00100000:0.0:1783349853.788444:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 151 00000100:00100000:0.0:1783349853.788450:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642615040:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349853.788473:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642615040:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (5195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349853.788479:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 151 00000100:00100000:0.0:1783349853.788489:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 152 00000100:00100000:0.0:1783349853.788494:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642614912:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349853.788657:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642614912:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 161us (5326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349853.788664:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 152 00000100:00100000:0.0:1783349853.788693:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 153 00000100:00100000:0.0:1783349853.788701:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642615168:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349853.788729:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+2:2398:x1869977642615296:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 423us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349853.788738:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:0.0:1783349853.788750:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642615168:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 49us (5403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349853.788757:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:0.0:1783349853.788762:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 153 00000100:00100000:2.0:1783349853.788770:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2398:x1869977642615424:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:2.0:1783349853.788783:0:8433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2179 00000100:00080000:0.0:1783349853.788787:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783349853.788791:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8ea24321b800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1783349853.788793:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349853.788796:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349853.788799:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:2.0:1783349853.788816:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1783349853.789048:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+2:2398:x1869977642615424:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 280us (2226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349853.789060:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00010000:00010000:2.0:1783349853.789084:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349853.789090:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349853.829281:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349854.852361:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349855.620880:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659465984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349855.620953:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349855.621050:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659465984 00000100:00100000:1.0:1783349855.621058:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659465984 00000100:00100000:1.0:1783349855.621102:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783349855.621110:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659465984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783349855.621603:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783349855.621690:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659465984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 580us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349855.621698:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783349855.621751:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659465984:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783349855.876558:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783349856.102976:0:13034:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1783349856.902035:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349857.156439:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659466112:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.156516:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349857.156545:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659466368:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.156578:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659466624:0@lo:400:kworker.0 00000100:00100000:1.0:1783349857.156586:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349857.156615:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349857.156617:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659466880:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.156644:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659467136:0@lo:400:kworker.0 00000100:00100000:1.0:1783349857.156650:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349857.156677:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659467392:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.156680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349857.156705:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659467648:0@lo:400:kworker.0 00000100:00100000:1.0:1783349857.156711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349857.156733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349857.156741:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783349857.156749:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659466496:0@lo:400:kworker.0 00000100:00100000:1.0:1783349857.156772:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349857.156787:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659467008:0@lo:400:kworker.0 00000100:00100000:1.0:1783349857.156820:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659466112 00000100:00100000:1.0:1783349857.156834:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659466112 00000100:00100000:1.0:1783349857.156902:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1783349857.156910:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659466112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349857.156957:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659466112:12345-0@lo:400:kworker.0 Request processed in 48us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349857.156965:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1783349857.156997:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659466368 00000100:00100000:1.0:1783349857.157012:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659466368 00000100:00100000:1.0:1783349857.157035:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659466624 00000100:00100000:1.0:1783349857.157038:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659466624 00000100:00100000:1.0:1783349857.157053:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783349857.157059:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659466368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349857.157097:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659466368:12345-0@lo:400:kworker.0 Request processed in 38us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349857.157104:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783349857.157116:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783349857.157122:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fc8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659466624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.157233:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659466112:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.157272:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659466624:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.157281:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783349857.157295:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659466240:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.157318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349857.157334:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659466752:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.157351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349857.157368:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659466880 00000100:00100000:2.0:1783349857.157374:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659466880 00000100:00100000:2.0:1783349857.157414:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659467392 00000100:00100000:2.0:1783349857.157417:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659467392 00000100:00100000:2.0:1783349857.157430:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659466496 00000100:00100000:2.0:1783349857.157432:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659466496 00000100:00100000:2.0:1783349857.157441:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659466240 00000100:00100000:2.0:1783349857.157444:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659466240 00000100:00100000:2.0:1783349857.157453:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659466752 00000100:00100000:2.0:1783349857.157456:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659466752 00000100:00100000:2.0:1783349857.157469:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783349857.157475:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659466880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349857.157508:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659466880:12345-0@lo:400:kworker.0 Request processed in 34us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349857.157514:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783349857.157527:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659467264:0@lo:400:kworker.0 00000100:00100000:2.0:1783349857.157530:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783349857.157541:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659467392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.157567:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349857.157581:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659467392:12345-0@lo:400:kworker.0 Request processed in 40us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349857.157588:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783349857.157601:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659467264 00000100:00100000:0.0:1783349857.157601:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659467136 00000100:00100000:2.0:1783349857.157606:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659467264 00000100:00100000:0.0:1783349857.157608:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659467136 00000100:00100000:2.0:1783349857.157627:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783349857.157634:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659466496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349857.157669:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659466496:12345-0@lo:400:kworker.0 Request processed in 36us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349857.157674:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783349857.157686:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783349857.157691:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659466240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349857.157722:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659466240:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349857.157728:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783349857.157740:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783349857.157746:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659466752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349857.157770:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659466752:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349857.157775:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783349857.157785:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783349857.157790:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659467264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349857.157812:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659467264:12345-0@lo:400:kworker.0 Request processed in 23us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349857.157817:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1783349857.157831:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349857.157836:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349857.157837:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783349857.157856:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659466240:0@lo:400:kworker.0 00000100:00100000:2.0:1783349857.157866:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659466752:0@lo:400:kworker.0 00000100:00100000:2.0:1783349857.157875:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659467264:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.158334:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659467648 00000100:00100000:0.0:1783349857.158339:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659467648 00000100:00100000:0.0:1783349857.158368:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783349857.158387:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659467136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.158431:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659467136:12345-0@lo:400:kworker.0 Request processed in 44us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349857.158437:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783349857.158450:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783349857.158454:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659467648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.158481:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659467648:12345-0@lo:400:kworker.0 Request processed in 26us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349857.158487:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1783349857.158708:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349857.158721:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659467776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349857.158755:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783349857.158839:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b25f80 x1869977659467136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349857.158853:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659467136:0@lo:400:kworker.0 00010000:00080000:2.0:1783349857.158864:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b27800 x1869977659467648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349857.158885:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659467648:0@lo:400:kworker.0 00000100:00100000:1.0:1783349857.158958:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fc8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659466624:12345-0@lo:400:kworker.0 Request processed in 52us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349857.158970:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783349857.159375:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659467776 00000100:00100000:1.0:1783349857.159446:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659467776 00000100:00100000:0.0:1783349857.159491:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659468032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349857.159533:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349857.159602:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349857.159608:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659467904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349857.159631:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349857.159710:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659468032 00000100:00100000:2.0:1783349857.159715:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659468032 00000100:00100000:2.0:1783349857.159790:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659467904 00000100:00100000:2.0:1783349857.159794:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659467904 00000100:00100000:2.0:1783349857.159808:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783349857.159815:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36e13ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659468032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783349857.159839:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349857.159897:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36e13ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659468032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349857.159905:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783349857.159925:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783349857.159937:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659467776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783349857.159964:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783349857.160026:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659467776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349857.160035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783349857.160064:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783349857.160074:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659467904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349857.160096:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349857.160125:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659467904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349857.160131:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1783349857.160187:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a1a680 x1869977659467904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349857.160201:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659467904:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1783349857.160211:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a18000 x1869977659468032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349857.160239:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659468032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349857.160284:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659467776:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1783349857.160674:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349857.160709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349857.160740:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659467520:0@lo:400:kworker.0 00000100:00100000:1.0:1783349857.160768:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349857.160848:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659466368:0@lo:400:kworker.0 00010000:00080000:1.0:1783349857.160861:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b25c00 x1869977659466880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349857.160948:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659466880:0@lo:400:kworker.0 00010000:00080000:1.0:1783349857.160964:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b27b80 x1869977659467392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349857.160972:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659467392:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.161021:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659467008 00000100:00100000:0.0:1783349857.161027:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659467008 00000100:00100000:1.0:1783349857.161052:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659466496:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.161079:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659467520 00000100:00100000:0.0:1783349857.161084:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659467520 00000100:00100000:0.0:1783349857.161103:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783349857.161160:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783349857.161170:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659467520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349857.161225:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659467520:12345-0@lo:400:kworker.0 Request processed in 57us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349857.161231:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1783349857.161249:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783349857.161556:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b25880 x1869977659467520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349857.161566:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659467520:0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.161622:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659467008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349857.161681:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659467008:12345-0@lo:400:kworker.0 Request processed in 571us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349857.161692:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1783349857.161728:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b27100 x1869977659467008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349857.161739:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659467008:0@lo:400:kworker.0 00010000:00010000:2.0:1783349857.926151:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349858.695023:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349858.695055:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659468160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349858.695128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349858.695275:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659468160 00000100:00100000:3.0:1783349858.695281:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659468160 00000100:00100000:3.0:1783349858.695322:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783349858.695329:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659468160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783349858.695356:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349858.695511:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659468160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 182us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349858.695518:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1783349858.695553:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b2f800 x1869977659468160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349858.695569:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659468160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349858.695857:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659468288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349858.695894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349858.695993:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659468288 00000100:00100000:0.0:1783349858.695998:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659468288 00000100:00100000:0.0:1783349858.696059:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783349858.696067:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659468288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349858.696080:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349858.696331:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659468288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 264us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349858.696337:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1783349858.696431:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a18000 x1869977659468288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349858.696444:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659468288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349858.904447:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349858.904525:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349858.909062:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349858.909105:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349858.910426:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642615680 00000100:00100000:2.0:1783349858.910442:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642615680 00000100:00100000:2.0:1783349858.910521:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642615936 00000100:00100000:2.0:1783349858.910525:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642615936 00000100:00100000:2.0:1783349858.910554:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 160 00000100:00100000:2.0:1783349858.910563:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642615680:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349858.910640:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642615680:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 78us (6204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349858.910646:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 160 00000100:00100000:2.0:1783349858.910670:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 161 00000100:00100000:2.0:1783349858.910677:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642615936:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349858.910703:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642615936:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (6178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349858.910709:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 161 00000100:00100000:2.0:1783349858.910727:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642615552 00000100:00100000:2.0:1783349858.910730:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642615552 00000100:00100000:2.0:1783349858.910762:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 307 00000100:00100000:2.0:1783349858.910768:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642615552:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349858.910790:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642615552:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349858.910796:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 307 00000100:00080000:2.0:1783349858.910837:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349858.915122:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349858.915175:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642615808 00000100:00100000:3.0:1783349858.915184:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642615808 00000100:00100000:3.0:1783349858.915247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642616064 00000100:00100000:3.0:1783349858.915259:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642616064 00000100:00100000:3.0:1783349858.915287:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 162 00000100:00100000:3.0:1783349858.915295:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642615808:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349858.915364:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642615808:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 70us (6259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349858.915372:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 162 00000100:00100000:3.0:1783349858.915388:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 163 00000100:00100000:3.0:1783349858.915395:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642616064:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349858.915417:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642616064:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349858.915422:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 163 00000100:00080000:3.0:1783349858.915437:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783349858.948244:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783349858.958627:0:13181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff533c1c60 20000000:00000080:0.0:1783349858.958646:0:13181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ea243a91000 uarg=0000000000000000 20000000:01000000:0.0:1783349858.958689:0:13181:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783349858.958696:0:13181:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783349858.958701:0:13181:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783349858.960729:0:13182:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1783349858.960892:0:13181:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783349858.969637:0:13181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783349858.969666:0:13181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.969685:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e2092 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd9f expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.969714:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e20bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e20b5 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.969722:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e20e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e20df expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.969729:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e2110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2109 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.969735:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e213a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2133 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.969743:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e215d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdde expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.969750:0:13181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.969792:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e215d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdde expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.969808:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e215d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdde expref: 12 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349858.969823:0:13181:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659468416:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349858.969949:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e213a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e2133 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.969957:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e213a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e2133 expref: 23 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349858.969972:0:13181:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659468544:0@lo:104: 00000100:00100000:0.0:1783349858.970013:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349858.970048:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e2110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e2109 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.970057:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e2110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e2109 expref: 23 pid: 6511 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349858.970066:0:13181:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659468672:0@lo:104: 00000100:00100000:0.0:1783349858.970086:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349858.970115:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e20e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e20df expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.970123:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e20e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e20df expref: 23 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349858.970131:0:13181:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659468800:0@lo:104: 00000100:00100000:0.0:1783349858.970176:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349858.970193:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e20bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e20b5 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.970201:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e20bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e20b5 expref: 23 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349858.970209:0:13181:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659468928:0@lo:104: 00000100:00100000:0.0:1783349858.970228:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349858.970426:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659468544 00000100:00100000:3.0:1783349858.970434:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659468544 00000100:00100000:3.0:1783349858.970470:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659468672 00000100:00100000:3.0:1783349858.970474:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659468672 00000100:00100000:3.0:1783349858.970483:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659468800 00000100:00100000:3.0:1783349858.970485:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659468800 00000100:00100000:3.0:1783349858.970493:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659468928 00000100:00100000:3.0:1783349858.970495:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659468928 00000100:00100000:3.0:1783349858.970508:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783349858.970516:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:13181:x1869977659468544:12345-0@lo:104: 00010000:00010000:3.0:1783349858.970527:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.970577:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349858.970583:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:13181:x1869977659468544:12345-0@lo:104: Request processed in 68us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349858.970601:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783349858.970620:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783349858.970626:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:13181:x1869977659468672:12345-0@lo:104: 00010000:00010000:3.0:1783349858.970635:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.970666:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783349858.970671:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:13181:x1869977659468672:12345-0@lo:104: Request processed in 45us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349858.970676:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783349858.970687:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783349858.970693:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:13181:x1869977659468800:12345-0@lo:104: 00010000:00010000:3.0:1783349858.970699:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.970725:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783349858.970729:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:13181:x1869977659468800:12345-0@lo:104: Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349858.970734:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783349858.970744:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783349858.970749:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:13181:x1869977659468928:12345-0@lo:104: 00010000:00010000:3.0:1783349858.970755:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.971036:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783349858.971041:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:13181:x1869977659468928:12345-0@lo:104: Request processed in 292us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349858.971054:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1783349858.971074:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783349858.971080:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.971088:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:3.0:1783349858.971097:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.971107:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349858.971114:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349858.971121:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349858.972989:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783349858.973001:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973012:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349858.973016:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973025:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349858.973031:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349858.973037:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349858.973087:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973101:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349858.973127:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.973348:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e2092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd9f expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.973389:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e2092 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd9f expref: 12 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349858.973405:0:13181:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659469184:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349858.973483:0:13181:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508c1300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349858.973510:0:13181:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659468544:0@lo:104: 00000100:00100000:0.0:1783349858.973520:0:13181:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659468672:0@lo:104: 00000100:00100000:0.0:1783349858.973529:0:13181:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659468800:0@lo:104: 00000100:00100000:0.0:1783349858.973543:0:13181:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659468928:0@lo:104: 00010000:00010000:2.0:1783349858.973577:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2109 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e2110 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973595:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349858.973598:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973615:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3429f1800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349858.973619:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973626:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349858.973632:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349858.973637:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349858.973694:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973701:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349858.973710:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973715:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3429f1800/0xd05e6ae1590e20df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e20e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973725:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349858.973728:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973733:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349858.973736:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.973752:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349858.973758:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349858.973763:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783349858.973948:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.973957:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349858.973978:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.973984:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc200/0xd05e6ae1590e2133 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e213a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.973992:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349858.973994:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349858.973996:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349858.974004:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349858.974025:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659469440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349858.974067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349858.974099:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349858.974120:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659469312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349858.974174:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349858.974198:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659469440 00000100:00100000:3.0:1783349858.974199:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349858.974208:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659469056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349858.974208:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659469440 00010000:00010000:0.0:1783349858.974244:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e213a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e2133 expref: 24 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349858.974249:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349858.974279:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659469312 00000100:00100000:0.0:1783349858.974283:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659469312 00000100:00100000:3.0:1783349858.974287:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659469056 00000100:00100000:3.0:1783349858.974292:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659469056 00010000:00010000:0.0:1783349858.974298:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e20e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e20df expref: 26 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.974313:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e2110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e2109 expref: 26 pid: 6511 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349858.974318:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783349858.974332:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+26:3647:x1869977659469440:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349858.974339:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1783349858.974346:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783349858.974351:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+26:3649:x1869977659469312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349858.974356:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e213a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e2133 expref: 26 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.974363:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349858.974369:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e20e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e20df expref: 26 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.974387:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e213a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e2133 expref: 26 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349858.975687:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1783349858.975699:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1783349858.975713:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1783349858.975722:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783349858.975730:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+26:3649:x1869977659469056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783349858.975741:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349858.975748:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e2110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e2109 expref: 26 pid: 6511 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.975798:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e20e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e20df expref: 26 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.975933:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e2110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e2109 expref: 26 pid: 6511 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.975962:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e2110 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e2109 expref: 26 pid: 6511 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.975974:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349858.976044:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+25:3649:x1869977659469056:12345-0@lo:103:ldlm_bl.0 Request processed in 304us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349858.976052:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1783349858.976493:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.976502:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349858.976523:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.976531:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd000/0xd05e6ae1590e20b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e20bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.976546:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349858.976548:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349858.976550:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349858.976557:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349858.976570:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659469568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349858.976606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349858.976643:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783349858.976650:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659469568 00000100:00100000:2.0:1783349858.976656:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659469568 00010000:00010000:2.0:1783349858.976675:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e20bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e20b5 expref: 25 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349858.976689:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783349858.976702:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783349858.976709:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+25:3646:x1869977659469568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349858.976720:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349858.976725:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e20bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e20b5 expref: 25 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.976733:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e20bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e20b5 expref: 25 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.976743:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f1200/0xd05e6ae1590e20bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e20b5 expref: 25 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.976753:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349858.976778:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659469568:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349858.976785:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783349858.976812:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659469568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349858.978340:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659469056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783349858.979485:0:13181:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659468416:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349858.979497:0:13181:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1869977659469184:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349858.979527:0:13181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.981567:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e20e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e20df expref: 23 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349858.981591:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349858.981683:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:3649:x1869977659469312:12345-0@lo:103:ldlm_bl.0 Request processed in 7333us (7506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349858.981695:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1783349858.981804:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e213a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e2133 expref: 21 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.981816:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349858.981934:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659469312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349858.981956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349858.981989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349858.982020:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642616192 00000100:00100000:2.0:1783349858.982027:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642616192 00010000:00010000:2.0:1783349858.982055:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e215d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdde expref: 13 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349858.982076:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642616320 00000100:00100000:2.0:1783349858.982078:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642616320 00010000:00010000:2.0:1783349858.982088:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e2092 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd9f expref: 14 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349858.982129:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:2.0:1783349858.982155:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+14:2399:x1869977642616192:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349858.982170:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349858.982174:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e215d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdde expref: 14 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.982185:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e215d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdde expref: 14 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.982197:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8ca00/0xd05e6ae1590e215d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdde expref: 14 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349858.982206:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349858.982256:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642616192:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 119us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349858.982263:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:1.0:1783349858.982278:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:1.0:1783349858.982290:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350949050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:2399:x1869977642616320:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349858.982300:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349858.982307:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e2092 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd9f expref: 12 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982320:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e2092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd9f expref: 12 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349858.982321:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:3647:x1869977659469440:12345-0@lo:103:ldlm_bl.0 Request processed in 7991us (8251us total) trans 0 rc 0/0 00010000:00010000:1.0:1783349858.982341:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8ec00/0xd05e6ae1590e2092 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd9f expref: 12 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982353:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982368:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982384:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982391:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982397:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982404:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982410:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ee00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783349858.982414:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982422:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982435:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.982444:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349858.982469:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350949050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:2399:x1869977642616320:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 182us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349858.985473:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659469440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349858.987222:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783349858.987237:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00010000:00010000:1.0:1783349858.987299:0:13181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.987325:0:13181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349858.987332:0:13181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8ee00/0xd05e6ae1590e2180 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1783349859.212032:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000020:00000080:1.0:1783349859.212041:0:9511:0:(genops.c:906:class_export_put()) final put ffff8ea24321f800/2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000020:00000080:2.0:1783349859.212190:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24321f800/2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 for lustre-OST0001 00000020:00000080:2.0:1783349859.212245:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea24321b800 for lustre-OST0001 00000001:00100000:0.0:1783349859.212742:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000020:00000080:0.0:1783349859.212747:0:8426:0:(genops.c:906:class_export_put()) final put ffff8ea2434da000/2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000020:00000080:2.0:1783349859.212811:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2434da000/2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 for lustre-OST0000 00000020:00000080:2.0:1783349859.212845:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2434dc800 for lustre-OST0000 00010000:00010000:3.0:1783349859.972447:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349860.439917:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349860.440059:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642616448 00000100:00100000:1.0:1783349860.440070:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642616448 00000100:00100000:1.0:1783349860.440129:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 308 00000100:00100000:1.0:1783349860.440160:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:6167:x1869977642616448:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349860.440178:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349860.440197:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e2187 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece0f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.440225:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e2187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece0f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.440238:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e2187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece0f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.440247:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8dc00, rc 0) 00000100:00100000:1.0:1783349860.440298:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642616448:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 160us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349860.440306:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 308 00000100:00100000:3.0:1783349860.443925:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349860.443988:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642616576 00000100:00100000:2.0:1783349860.443997:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642616576 00000100:00100000:2.0:1783349860.444054:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 309 00000100:00100000:2.0:1783349860.444063:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642616576:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349860.444242:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642616576:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 179us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349860.444256:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 309 00000100:00100000:1.0:1783349860.451641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349860.451845:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642616704 00000100:00100000:0.0:1783349860.451855:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642616704 00000100:00100000:0.0:1783349860.451918:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 310 00000100:00100000:0.0:1783349860.451928:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642616704:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.452074:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642616704:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 146us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349860.452082:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 310 00000100:00100000:0.0:1783349860.457548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349860.458266:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642616832 00000100:00100000:1.0:1783349860.458277:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642616832 00000100:00100000:1.0:1783349860.458330:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 311 00000100:00100000:1.0:1783349860.458341:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642616832:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349860.458358:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349860.458374:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e218e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece16 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.458403:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e218e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece16 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.458415:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e218e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece16 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.458424:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d200, rc 0) 00000100:00100000:1.0:1783349860.458482:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:6167:x1869977642616832:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 142us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349860.458490:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 311 00000100:00100000:1.0:1783349860.461506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349860.461580:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642616960 00000100:00100000:3.0:1783349860.461589:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642616960 00000100:00100000:3.0:1783349860.461669:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 312 00000100:00100000:3.0:1783349860.461679:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:6167:x1869977642616960:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349860.461821:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:6167:x1869977642616960:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 143us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349860.461829:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 312 00000100:00100000:1.0:1783349860.467027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349860.467115:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642617088 00000100:00100000:0.0:1783349860.467125:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642617088 00000100:00100000:0.0:1783349860.467192:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 313 00000100:00100000:0.0:1783349860.467202:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:6167:x1869977642617088:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.467353:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:6167:x1869977642617088:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 152us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349860.467362:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 313 10000000:01000000:1.0:1783349860.548242:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783349860.548250:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d976000 from 7 10000000:01000000:1.0:1783349860.548255:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783349860.548302:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.548315:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.548327:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349860.548366:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659469696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783349860.548432:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349860.548499:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77240 going to sleep for 11 seconds 00000100:00100000:3.0:1783349860.549829:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659469696 00000100:00100000:3.0:1783349860.549842:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659469696 00000100:00100000:3.0:1783349860.549909:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1783349860.549918:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659469696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349860.549933:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349860.549950:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e219c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2195 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349860.549976:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e219c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2195 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349860.549986:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e219c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2195 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349860.549995:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea38215fe00, rc 0) 00000100:00100000:3.0:1783349860.550111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659469696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349860.550118:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1783349860.552422:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659469696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349860.552448:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.552459:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349860.552602:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659469824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349860.552656:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349860.552700:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77240 going to sleep for 11 seconds 00000100:00100000:3.0:1783349860.552778:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659469824 00000100:00100000:3.0:1783349860.552784:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659469824 00000100:00100000:3.0:1783349860.552881:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1783349860.552890:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659469824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349860.553010:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659469824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349860.553017:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1783349860.553076:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659469824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349860.553102:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659469952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349860.553155:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349860.556683:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349860.556764:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659469952 00000100:00100000:0.0:1783349860.556774:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659469952 00000100:00100000:0.0:1783349860.556825:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1783349860.556834:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659469952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.556975:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659469952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (3818us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349860.556982:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1783349860.557048:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659469952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783349860.561241:0:13238:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783349860.561349:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783349860.561373:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349860.561385:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.561397:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349860.561407:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349860.561409:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d918000 from 7 10000000:01000000:0.0:1783349860.561413:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349860.561449:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.561458:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.561468:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349860.561506:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.561579:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349860.561614:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243107300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349860.561634:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659470080 00000100:00100000:0.0:1783349860.561641:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659470080 00000100:00100000:0.0:1783349860.561679:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1783349860.561687:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659470080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349860.561701:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349860.561713:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e21aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e21a3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.561734:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e21aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e21a3 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.561744:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e21aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e21a3 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.561752:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8fe00, rc 0) 00000100:00100000:0.0:1783349860.561786:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659470080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349860.561792:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1783349860.561837:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349860.561851:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.561858:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349860.561922:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.561954:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349860.561967:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243107300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349860.561979:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659470208 00000100:00100000:0.0:1783349860.561982:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659470208 00000100:00100000:0.0:1783349860.561999:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1783349860.562005:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659470208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.562100:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659470208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349860.562107:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1783349860.562157:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.562182:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.562218:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349860.562231:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243107300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349860.562242:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659470336 00000100:00100000:0.0:1783349860.562245:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659470336 00000100:00100000:0.0:1783349860.562261:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1783349860.562266:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659470336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.562331:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659470336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349860.562338:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1783349860.562375:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783349860.563121:0:13239:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783349860.563209:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783349860.563224:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349860.563233:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.563250:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349860.563260:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349860.563262:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea357ed9800 from 7 10000000:01000000:0.0:1783349860.563265:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349860.563286:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.563293:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.563301:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349860.563316:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.563348:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349860.563363:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243107600 going to sleep for 11 seconds 00000100:00100000:0.0:1783349860.563378:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659470464 00000100:00100000:0.0:1783349860.563381:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659470464 00000100:00100000:0.0:1783349860.563405:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1783349860.563412:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659470464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349860.563421:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349860.563430:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e21b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e21b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.563448:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e21b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e21b1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.563468:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e21b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e21b1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.563476:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e400, rc 0) 00000100:00100000:0.0:1783349860.563504:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659470464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349860.563510:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1783349860.563541:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349860.563552:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.563560:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349860.563597:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.563621:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349860.563632:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243107600 going to sleep for 11 seconds 00000100:00100000:0.0:1783349860.563642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659470592 00000100:00100000:0.0:1783349860.563645:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659470592 00000100:00100000:0.0:1783349860.563660:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1783349860.563665:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659470592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.563738:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659470592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349860.563745:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1783349860.563776:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.563810:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.563844:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349860.564778:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243107600 going to sleep for 11 seconds 00000100:00100000:1.0:1783349860.568274:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659470720 00000100:00100000:1.0:1783349860.568290:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659470720 00000100:00100000:1.0:1783349860.568371:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1783349860.568383:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659470720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349860.569002:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659470720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 620us (5155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349860.569010:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783349860.569127:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783349860.574996:0:13240:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783349860.575178:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783349860.575280:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783349860.575293:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.575304:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349860.575316:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783349860.575318:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea3461c1000 from 7 10000000:01000000:1.0:1783349860.575321:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783349860.575359:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.575367:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.575377:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349860.575401:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783349860.575469:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349860.575583:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349860.575689:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659470848 00000100:00100000:0.0:1783349860.575697:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659470848 00000100:00100000:0.0:1783349860.575954:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1783349860.575965:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659470848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349860.575978:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349860.575991:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e21c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e21bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.576013:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e21c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e21bf expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.576024:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e21c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e21bf expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.576033:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f800, rc 0) 00000100:00100000:0.0:1783349860.576067:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659470848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349860.576075:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1783349860.576284:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349860.576299:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.576307:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349860.576378:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349860.576406:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349860.576430:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36db77240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349860.576562:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659470976 00000100:00100000:0.0:1783349860.576567:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659470976 00000100:00100000:0.0:1783349860.576630:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1783349860.576637:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659470976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349860.576744:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659470976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349860.576756:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783349860.576808:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659470976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349860.576837:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659471104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349860.576885:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349860.576963:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349860.576995:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659471104 00000100:00100000:1.0:1783349860.577000:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659471104 00000100:00100000:1.0:1783349860.577019:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1783349860.577025:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659471104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349860.577091:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659471104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349860.577098:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783349860.577326:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659471104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783349860.579411:0:13241:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783349860.579739:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783349860.579763:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783349860.579774:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.579787:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349860.742555:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659471232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349860.742626:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349860.744608:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659471232 00000100:00100000:2.0:1783349860.744621:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659471232 00000100:00100000:2.0:1783349860.744683:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783349860.744693:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659471232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783349860.744728:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783349860.744799:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659471232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349860.744807:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783349860.744871:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659471232:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783349860.996360:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349862.022286:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349862.173574:0:13381:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783349862.278007:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349862.278033:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659471360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349862.278116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349862.278394:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349862.278406:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659471488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349862.278437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349862.278467:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659471488 00000100:00100000:0.0:1783349862.278473:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659471488 00000100:00100000:0.0:1783349862.278525:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783349862.278533:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659471488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783349862.278558:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349862.278590:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659471488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349862.278595:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1783349862.278611:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783349862.278632:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da7800 x1869977659471488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349862.278645:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659471488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349862.278836:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659471360 00000100:00100000:1.0:1783349862.278842:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659471360 00000100:00100000:2.0:1783349862.278886:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659471616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349862.278891:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783349862.278902:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659471360:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349862.278921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1783349862.278946:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349862.279029:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659471744:0@lo:400:kworker.0 00000100:00100000:2.0:1783349862.279204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349862.279334:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659471360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 434us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349862.279341:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783349862.279365:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659471744 00000100:00100000:1.0:1783349862.279369:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659471744 00000100:00100000:1.0:1783349862.279394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1783349862.279402:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659471744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.279442:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659471744:12345-0@lo:400:kworker.0 Request processed in 41us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349862.279450:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783349862.279492:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659471616 00000100:00100000:0.0:1783349862.279496:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659471616 00000100:00100000:0.0:1783349862.279524:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783349862.279531:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659471616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349862.279544:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349862.279574:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659471616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349862.279580:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1783349862.279605:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349862.279619:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659472128:0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.279648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349862.279667:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659472640:0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.279689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783349862.279715:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b27b80 x1869977659471616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349862.279718:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659472000:0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.279738:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659471616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349862.279758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349862.279766:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659472128 00000100:00100000:0.0:1783349862.279771:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659472128 00000100:00100000:1.0:1783349862.279785:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659472512:0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.279805:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783349862.279812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349862.279817:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659472128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.279860:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659472000 00000100:00100000:1.0:1783349862.279865:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659472000 00000100:00100000:0.0:1783349862.279874:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659472128:12345-0@lo:400:kworker.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349862.279881:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783349862.279894:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783349862.279903:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659472000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.279906:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659472640 00000100:00100000:0.0:1783349862.279911:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659472640 00000100:00100000:1.0:1783349862.279947:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659472000:12345-0@lo:400:kworker.0 Request processed in 45us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349862.279955:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783349862.279958:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659472512 00000100:00100000:0.0:1783349862.279963:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659472512 00000100:00100000:1.0:1783349862.280041:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783349862.280049:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659472640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.280082:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659472640:12345-0@lo:400:kworker.0 Request processed in 34us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349862.280094:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783349862.280114:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659471872:0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.280158:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783349862.280166:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349862.280171:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659472512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.280208:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659472512:12345-0@lo:400:kworker.0 Request processed in 42us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349862.280214:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783349862.280316:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659472384:0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.280340:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349862.280361:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659472896:0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.280385:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349862.280386:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659471360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349862.280409:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659472256:0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.280421:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659471872 00000100:00100000:1.0:1783349862.280426:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659471872 00000100:00100000:2.0:1783349862.280439:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349862.280459:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659472768:0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.280460:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659472384 00000100:00100000:1.0:1783349862.280467:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659472384 00000100:00100000:2.0:1783349862.280488:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349862.280501:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659472896 00000100:00100000:0.0:1783349862.280506:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659472896 00000100:00100000:2.0:1783349862.280516:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659471744:0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.280527:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659472256 00000100:00100000:0.0:1783349862.280536:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659472256 00000100:00100000:0.0:1783349862.280552:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659472768 00000100:00100000:0.0:1783349862.280555:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659472768 00000100:00100000:1.0:1783349862.280570:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783349862.280579:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659471872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.280659:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783349862.280666:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659472896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.280710:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659472896:12345-0@lo:400:kworker.0 Request processed in 45us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349862.280716:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783349862.280728:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783349862.280735:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659472256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.280759:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659471872:12345-0@lo:400:kworker.0 Request processed in 179us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349862.280767:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783349862.280779:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659472256:12345-0@lo:400:kworker.0 Request processed in 43us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349862.280787:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783349862.280795:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659472384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.280801:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783349862.280818:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783349862.280825:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659472768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349862.280832:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659471872:0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.280846:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659472384:12345-0@lo:400:kworker.0 Request processed in 50us (502us total) trans 0 rc 0/0 00010000:00080000:2.0:1783349862.280860:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437fea00 x1869977659472384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349862.280871:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783349862.280872:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659472768:12345-0@lo:400:kworker.0 Request processed in 46us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349862.280875:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659472384:0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.280880:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00010000:00080000:2.0:1783349862.280889:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437ff100 x1869977659472896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349862.280898:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659472896:0@lo:400:kworker.0 00000100:00080000:0.0:1783349862.280902:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783349862.280905:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349862.280908:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349862.280925:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659472000:0@lo:400:kworker.0 00010000:00080000:1.0:1783349862.280940:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437fc700 x1869977659472512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349862.280951:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659472512:0@lo:400:kworker.0 00000100:00100000:0.0:1783349862.280959:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659472128:0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.281354:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659472256:0@lo:400:kworker.0 00000100:00100000:1.0:1783349862.281368:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659472768:0@lo:400:kworker.0 00010000:00080000:0.0:1783349862.281558:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437fdc00 x1869977659472640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349862.281572:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659472640:0@lo:400:kworker.0 00010000:00010000:3.0:1783349863.044362:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349863.812395:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659473024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783349863.812468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349863.812529:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349863.812536:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659473152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349863.812558:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349863.812589:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659473024 00000100:00100000:1.0:1783349863.812597:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659473024 00000100:00100000:1.0:1783349863.812634:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659473152 00000100:00100000:1.0:1783349863.812637:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659473152 00000100:00100000:1.0:1783349863.812654:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783349863.812661:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659473024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783349863.812688:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349863.812731:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659473024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349863.812738:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783349863.812753:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783349863.812760:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659473152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349863.812770:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349863.812793:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659473152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349863.812813:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1783349863.812862:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a18a80 x1869977659473152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349863.812900:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659473152:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1783349863.812914:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370df5500 x1869977659473024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349863.812924:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659473024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349864.021866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349864.021928:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349864.021958:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349864.021991:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349864.022177:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642617472 00000100:00100000:1.0:1783349864.022189:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642617472 00000100:00100000:3.0:1783349864.022205:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642617216 00000100:00100000:3.0:1783349864.022211:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642617216 00000100:00100000:1.0:1783349864.022253:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642617728 00000100:00100000:1.0:1783349864.022258:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642617728 00000100:00100000:3.0:1783349864.022262:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 327 00000100:00100000:3.0:1783349864.022273:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642617216:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349864.022347:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642617216:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 76us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349864.022354:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 327 00000100:00100000:3.0:1783349864.022570:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 170 00000100:00100000:3.0:1783349864.022579:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642617472:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349864.022718:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00080000:0.0:1783349864.022731:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349864.022743:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642617344 00000100:00100000:0.0:1783349864.022747:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642617344 00000100:00100000:3.0:1783349864.023109:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642617472:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 56us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349864.024174:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 171 00000100:00100000:1.0:1783349864.024191:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642617728:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349864.024253:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642617728:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 68us (2293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349864.024260:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 171 00000100:00100000:1.0:1783349864.024281:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642617600 00000100:00100000:1.0:1783349864.024286:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642617600 00000100:00100000:1.0:1783349864.024311:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 172 00000100:00100000:1.0:1783349864.024317:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642617600:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349864.024406:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642617600:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 87us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349864.024413:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 172 00000100:00080000:1.0:1783349864.024648:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349864.032615:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 173 00000100:00100000:0.0:1783349864.032639:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642617344:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349864.033455:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642617344:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 823us (11457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349864.033466:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 173 00000100:00100000:3.0:1783349864.034666:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 170 00010000:00010000:3.0:1783349864.071203:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349865.095186:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349865.860698:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659473280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349865.860772:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349865.860978:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659473280 00000100:00100000:2.0:1783349865.860987:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659473280 00000100:00100000:2.0:1783349865.861041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783349865.861051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659473280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783349865.861084:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783349865.861160:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659473280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349865.861166:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783349865.861247:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659473280:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783349866.117168:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783349866.489277:0:13529:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:57:44 (1783349864) === 00000100:00100000:1.0:1783349866.663101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.663207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349866.663286:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642617856 00000100:00100000:0.0:1783349866.663296:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642617856 00000100:00100000:0.0:1783349866.663365:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:0.0:1783349866.663376:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642617856:12345-192.168.203.50@tcp:41:mkdir.0 00000004:00000024:0.0:1783349866.663413:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783349866.663492:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642617856:12345-192.168.203.50@tcp:41:mkdir.0 Request processed in 118us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349866.663501:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00080000:1.0:1783349866.663568:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349866.663620:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642617984 00000100:00100000:2.0:1783349866.663625:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642617984 00000100:00100000:2.0:1783349866.663658:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:2.0:1783349866.663666:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:689af055-7605-419d-81ba-26cff8cb556b+6:10473:x1869977642617984:12345-192.168.203.50@tcp:700:mkdir.0 00000100:00100000:2.0:1783349866.663701:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:689af055-7605-419d-81ba-26cff8cb556b+6:10473:x1869977642617984:12345-192.168.203.50@tcp:700:mkdir.0 Request processed in 36us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349866.663707:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:2.0:1783349866.667419:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.667537:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642618240 00000100:00100000:1.0:1783349866.667546:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642618240 00000100:00100000:1.0:1783349866.667717:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:1.0:1783349866.667729:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+6:10473:x1869977642618240:12345-192.168.203.50@tcp:36:mkdir.0 00010000:00010000:1.0:1783349866.667782:0:12147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349866.667810:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e206f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd8a expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.667839:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea34459e900) 00010000:00010000:1.0:1783349866.667850:0:12147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349866.667926:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.667938:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.667948:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.667960:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.667968:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.667974:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668529:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668546:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668554:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349866.668571:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a3a74f33 reply state 00000000e1bead41 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668582:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668589:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea2427f4700) 00010000:00010000:1.0:1783349866.668591:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349866.668594:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783349866.668599:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783349866.668605:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668610:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668617:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668622:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349866.668626:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668633:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668652:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2427f4300) 00010000:00010000:1.0:1783349866.668654:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349866.668658:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668664:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349866.668680:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a3a74f33 reply state 00000000e1bead41 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668687:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.668693:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ea2427f4800) 00010000:00010000:1.0:1783349866.668695:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349866.668697:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783349866.668883:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+7:10473:x1869977642618240:12345-192.168.203.50@tcp:36:mkdir.0 Request processed in 1155us (1470us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783349866.668891:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:3.0:1783349866.676349:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.676426:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642618368 00000100:00100000:1.0:1783349866.676436:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642618368 00000100:00100000:3.0:1783349866.676521:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:3.0:1783349866.676531:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+7:10474:x1869977642618368:12345-192.168.203.50@tcp:101:chmod.0 00010000:00010000:3.0:1783349866.676551:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349866.676572:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e21e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece1d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.676622:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e21e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.676634:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e21e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.676645:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e21e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349866.676688:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783349866.676692:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349866.676723:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e21e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.676747:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e21e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece1d expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.676775:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e21e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece1d expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.676781:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea34459e700) 00010000:00010000:3.0:1783349866.676783:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349866.676785:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd800, rc 0) 00000100:00100000:3.0:1783349866.676881:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+8:10474:x1869977642618368:12345-192.168.203.50@tcp:101:chmod.0 Request processed in 351us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349866.676885:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:3.0:1783349866.679422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349866.679518:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642618624 00000100:00100000:0.0:1783349866.679526:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642618624 00000100:00100000:0.0:1783349866.679577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:0.0:1783349866.679584:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+8:10474:x1869977642618624:12345-192.168.203.50@tcp:36:chmod.0 00010000:00010000:0.0:1783349866.679628:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349866.679654:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e21e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece1d expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.679736:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea34459e700) 00010000:00010000:0.0:1783349866.679744:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349866.679763:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.679771:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.679777:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349866.679963:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057184f45 reply state 00000000a6a023ee transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.679975:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.679981:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e98c00) 00010000:00010000:0.0:1783349866.679984:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783349866.679986:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783349866.679993:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783349866.680126:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+9:10474:x1869977642618624:12345-192.168.203.50@tcp:36:chmod.0 Request processed in 541us (710us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783349866.680172:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:2.0:1783349866.699471:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.699578:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642618752 00000100:00100000:1.0:1783349866.699587:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642618752 00000100:00100000:1.0:1783349866.699644:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:1.0:1783349866.699655:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+9:10475:x1869977642618752:12345-192.168.203.50@tcp:101:chown.0 00010000:00010000:1.0:1783349866.699679:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349866.699698:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece24 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.699780:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c400/0xd05e6ae1590e21fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.699793:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c400/0xd05e6ae1590e21fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.699802:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c400/0xd05e6ae1590e21fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349866.699851:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783349866.699854:0:12147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783349866.699887:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c400/0xd05e6ae1590e21fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.699909:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e21f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece24 expref: 11 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.699926:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c400/0xd05e6ae1590e21fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece24 expref: 10 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.699934:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e98c00) 00010000:00010000:1.0:1783349866.699936:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349866.699939:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c400, rc 0) 00000100:00100000:1.0:1783349866.700004:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+10:10475:x1869977642618752:12345-192.168.203.50@tcp:101:chown.0 Request processed in 351us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349866.700011:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:3.0:1783349866.703444:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349866.703561:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642618880 00000100:00100000:2.0:1783349866.703570:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642618880 00000100:00100000:2.0:1783349866.703624:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:2.0:1783349866.703634:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+10:10475:x1869977642618880:12345-192.168.203.50@tcp:101:chown.0 00010000:00010000:2.0:1783349866.703652:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349866.703674:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece2b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703733:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e220c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703746:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e220c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703756:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e220c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703767:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2213 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703773:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2213 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703779:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2213 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703864:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524600/0xd05e6ae1590e221a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703873:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524600/0xd05e6ae1590e221a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703892:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524600/0xd05e6ae1590e221a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349866.703933:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783349866.703937:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349866.703957:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524600/0xd05e6ae1590e221a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703968:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e220c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703975:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e220c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703982:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e220c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703987:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349866.703991:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e220c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.703999:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e220c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704010:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e98c00) 00010000:00010000:2.0:1783349866.704013:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349866.704017:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e220c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704024:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e220c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704397:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2213 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704404:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2213 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704410:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2213 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704415:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349866.704418:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2213 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704424:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2213 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704432:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ea2427f4800) 00010000:00010000:2.0:1783349866.704435:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349866.704438:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2213 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704444:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2213 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704473:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece2b expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704488:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524600/0xd05e6ae1590e221a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece2b expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.704507:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea2427f4700) 00010000:00010000:2.0:1783349866.704509:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349866.704512:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341524600, rc 0) 00000100:00100000:2.0:1783349866.704578:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+11:10475:x1869977642618880:12345-192.168.203.50@tcp:101:chown.0 Request processed in 945us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349866.704586:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:3.0:1783349866.706594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349866.706708:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642619008 00000100:00100000:0.0:1783349866.706717:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642619008 00000100:00100000:0.0:1783349866.706847:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:0.0:1783349866.706857:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:689af055-7605-419d-81ba-26cff8cb556b+11:10475:x1869977642619008:12345-192.168.203.50@tcp:900:chown.0 00000100:00100000:0.0:1783349866.706938:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:689af055-7605-419d-81ba-26cff8cb556b+11:10475:x1869977642619008:12345-192.168.203.50@tcp:900:chown.0 Request processed in 75us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349866.706959:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:0.0:1783349866.710307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.710439:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642619264 00000100:00100000:1.0:1783349866.710449:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642619264 00000100:00100000:1.0:1783349866.710516:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:1.0:1783349866.710527:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+11:10475:x1869977642619264:12345-192.168.203.50@tcp:36:chown.0 00010000:00010000:1.0:1783349866.710577:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349866.710599:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524600/0xd05e6ae1590e221a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece2b expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.710616:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea2427f4700) 00010000:00010000:1.0:1783349866.710620:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349866.710640:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.710652:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.710661:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349866.716089:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:1.0:1783349866.716234:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f404196 reply state 000000005be5bee7 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.716254:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.716263:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea2427f4700) 00010000:00010000:1.0:1783349866.716266:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783349866.716270:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783349866.716281:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1783349866.716356:0:6517:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1783349866.716379:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+9:10475:x1869977642619264:12345-192.168.203.50@tcp:36:chown.0 Request processed in 5851us (6076us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783349866.716388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00010000:00010000:2.0:1783349866.716870:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.716880:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.716887:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.716893:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349866.716898:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.716905:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.716917:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea2427f4700) 00010000:00010000:2.0:1783349866.716920:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783349866.716923:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.716929:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e2221 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717373:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717382:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717388:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717393:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ca00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349866.717396:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717403:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717422:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ea2427f4800) 00010000:00010000:3.0:1783349866.717424:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349866.717428:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717433:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e21d4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717448:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717453:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717459:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717463:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8da00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349866.717466:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717472:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717478:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea2427f4700) 00010000:00010000:3.0:1783349866.717480:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349866.717482:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717488:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e21db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717507:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717513:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717519:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717523:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349866.717526:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717532:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717538:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e98c00) 00010000:00010000:3.0:1783349866.717540:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783349866.717542:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.717547:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e21f0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349866.732298:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.732395:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642619392 00000100:00100000:1.0:1783349866.732404:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642619392 00000100:00100000:1.0:1783349866.732460:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:1.0:1783349866.732470:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+6:10476:x1869977642619392:12345-192.168.203.50@tcp:101:touch.500 00010000:00010000:1.0:1783349866.732491:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349866.732509:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e2228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece32 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783349866.736086:0:12147:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3526us 00010000:00010000:3.0:1783349866.747593:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e222f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747617:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e222f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747640:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e222f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747656:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e2236 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747663:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e2236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747670:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e2236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747788:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e223d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747810:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e223d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747827:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e223d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349866.747857:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783349866.747861:0:12147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349866.747895:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e223d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747907:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e222f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747913:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e222f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747929:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e222f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747935:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349866.747939:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e222f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747946:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e222f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747956:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e98c00) 00010000:00010000:3.0:1783349866.747959:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349866.747963:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e222f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747970:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e222f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747982:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e2236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747988:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e2236 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747993:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e2236 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.747998:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349866.748000:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e2236 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.748015:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e2236 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.748024:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ea34459e100) 00010000:00010000:3.0:1783349866.748026:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349866.748029:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e2236 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.748044:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e2236 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.748082:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e2228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece32 expref: 8 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.748098:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e223d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece32 expref: 7 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.748105:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea34459ea00) 00010000:00010000:3.0:1783349866.748108:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783349866.748110:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cda00, rc 0) 00000100:00100000:3.0:1783349866.748248:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+7:10476:x1869977642619392:12345-192.168.203.50@tcp:101:touch.500 Request processed in 15777us (15967us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349866.748257:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:0.0:1783349866.757487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349866.757587:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642619648 00000100:00100000:2.0:1783349866.757640:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642619648 00000100:00100000:2.0:1783349866.757696:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:2.0:1783349866.757705:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+7:10476:x1869977642619648:12345-192.168.203.50@tcp:101:touch.500 00010000:00010000:2.0:1783349866.757724:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349866.757741:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2244 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.757852:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e224b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.757867:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e224b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.757881:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e224b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.757896:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.757903:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.757909:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349866.758686:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1783349866.758831:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2259 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758851:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2259 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758859:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2259 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758893:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e224b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758900:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e224b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758906:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e224b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758913:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349866.758917:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e224b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758924:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e224b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758935:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea34459ea00) 00010000:00010000:2.0:1783349866.758938:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349866.758941:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e224b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758947:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e224b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349866.758961:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e148265 reply state 00000000f6f5c974 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758988:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.758994:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff8ea2424c5d00) 00010000:00010000:2.0:1783349866.758997:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783349866.758999:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783349866.759030:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2244 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece39 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.759055:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2259 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece39 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.759062:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ea2424c5c00) 00010000:00010000:2.0:1783349866.759065:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349866.759067:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341524a00, rc 0) 00000100:00100000:2.0:1783349866.759133:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+10:10476:x1869977642619648:12345-192.168.203.50@tcp:101:touch.500 Request processed in 1428us (1653us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783349866.759567:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:2.0:1783349866.762437:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.762488:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642619904 00000100:00100000:1.0:1783349866.762498:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642619904 00000100:00100000:1.0:1783349866.762585:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:1.0:1783349866.762595:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+10:10476:x1869977642619904:12345-192.168.203.50@tcp:36:touch.500 00010000:00010000:1.0:1783349866.762649:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349866.762673:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2259 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece39 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.762692:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ea2424c5c00) 00010000:00010000:1.0:1783349866.762702:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349866.762752:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.762764:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.762774:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349866.762880:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001eec3bc8 reply state 00000000084207a4 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.762906:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.762912:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ea2427f4300) 00010000:00010000:1.0:1783349866.762915:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349866.762917:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349866.763021:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+11:10476:x1869977642619904:12345-192.168.203.50@tcp:36:touch.500 Request processed in 427us (592us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783349866.763028:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:3.0:1783349866.764879:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.764955:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642620032 00000100:00100000:1.0:1783349866.764964:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642620032 00000100:00100000:1.0:1783349866.765066:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:1.0:1783349866.765076:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+11:10476:x1869977642620032:12345-192.168.203.50@tcp:101:touch.500 00010000:00010000:1.0:1783349866.765095:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349866.765112:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e226e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece40 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.765192:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e226e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece40 expref: 12 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.765205:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e226e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece40 expref: 12 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.765222:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ea2427f4300) 00010000:00010000:1.0:1783349866.765224:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783349866.765228:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8de00, rc 0) 00000100:00100000:1.0:1783349866.765271:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+12:10476:x1869977642620032:12345-192.168.203.50@tcp:101:touch.500 Request processed in 197us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349866.765287:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:3.0:1783349866.771978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.772301:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642620160 00000100:00100000:1.0:1783349866.772311:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642620160 00000100:00100000:1.0:1783349866.772352:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:1.0:1783349866.772360:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1869977642620160:12345-192.168.203.50@tcp:8:touch.500 00010000:00080000:1.0:1783349866.772403:0:9981:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:1.0:1783349866.772432:0:9981:0:(genops.c:1406:class_connect()) connect: client 689af055-7605-419d-81ba-26cff8cb556b, cookie 0xd05e6ae1590e2275 00002000:00100000:1.0:1783349866.772444:0:9981:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 689af055-7605-419d-81ba-26cff8cb556b/ffff8ea24321b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783349866.772463:0:9981:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783349866.772528:0:9981:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783349866.772566:0:9981:0:(import.c:65:import_set_state_nolock()) ffff8ea243219800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349866.772621:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2398:x1869977642620160:12345-192.168.203.50@tcp:8:touch.500 Request processed in 260us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349866.772628:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:2.0:1783349866.775763:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349866.776041:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642620288 00000100:00100000:0.0:1783349866.776051:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642620288 00000100:00100000:0.0:1783349866.776115:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:0.0:1783349866.776125:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+6:0:x1869977642620288:12345-192.168.203.50@tcp:2:touch.500 00000100:00080000:1.0:1783349866.776419:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1783349866.787454:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1783349866.787467:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000100:00100000:2.0:1783349866.787699:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+5:0:x1869977642620288:12345-192.168.203.50@tcp:2:touch.500 Request processed in 11565us (11933us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783349866.787711:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:3.0:1783349866.791251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349866.791501:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642620544 00000100:00100000:2.0:1783349866.791512:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642620544 00000100:00100000:2.0:1783349866.791575:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:2.0:1783349866.791586:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+12:10476:x1869977642620544:12345-192.168.203.50@tcp:35:touch.500 00000100:00100000:2.0:1783349866.791908:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+13:10476:x1869977642620544:12345-192.168.203.50@tcp:35:touch.500 Request processed in 324us (666us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783349866.791915:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:3.0:1783349866.804953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349866.805197:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642620672 00000100:00100000:2.0:1783349866.805209:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642620672 00000100:00100000:2.0:1783349866.805258:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:2.0:1783349866.805268:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+13:10477:x1869977642620672:12345-192.168.203.50@tcp:101:rm.0 00010000:00010000:2.0:1783349866.805361:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349866.805445:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e227c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.805513:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2283 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.805527:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.805539:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349866.805579:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783349866.805582:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349866.805615:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.805641:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e227c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece47 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.805877:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2283 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece47 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349866.805900:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea34459ea00) 00010000:00010000:2.0:1783349866.805903:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349866.805907:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341525c00, rc 0) 00000100:00100000:2.0:1783349866.806018:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+14:10477:x1869977642620672:12345-192.168.203.50@tcp:101:rm.0 Request processed in 741us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349866.806026:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:1.0:1783349866.808918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349866.809027:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642620928 00000100:00100000:0.0:1783349866.809043:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642620928 00000100:00100000:0.0:1783349866.809156:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:0.0:1783349866.809167:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+14:10477:x1869977642620928:12345-192.168.203.50@tcp:101:rm.0 00010000:00010000:0.0:1783349866.809185:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349866.809204:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e228a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece4e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349866.809452:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783349866.809548:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e228a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece4e expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.809561:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e98c00) 00010000:00010000:0.0:1783349866.809564:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349866.809568:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e228a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece4e expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.809599:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ec00, rc 0) 00000100:00100000:0.0:1783349866.809708:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+15:10477:x1869977642620928:12345-192.168.203.50@tcp:101:rm.0 Request processed in 542us (797us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1783349866.809720:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:3.0:1783349866.814671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349866.815791:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642621056 00000100:00100000:2.0:1783349866.815821:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642621056 00000100:00100000:2.0:1783349866.815886:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:2.0:1783349866.815896:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+15:10477:x1869977642621056:12345-192.168.203.50@tcp:37:rm.0 00000100:00100000:2.0:1783349866.821548:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+15:10477:x1869977642621056:12345-192.168.203.50@tcp:37:rm.0 Request processed in 5645us (6877us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349866.821558:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:1.0:1783349866.826955:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349866.827478:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642621312 00000100:00100000:3.0:1783349866.827488:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642621312 00000100:00100000:3.0:1783349866.827545:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1783349866.827555:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+15:10477:x1869977642621312:12345-192.168.203.50@tcp:35:rm.0 00000100:00100000:3.0:1783349866.828658:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+16:10477:x1869977642621312:12345-192.168.203.50@tcp:35:rm.0 Request processed in 1099us (1706us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783349866.828681:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:0.0:1783349866.832393:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.832538:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642621568 00000100:00100000:1.0:1783349866.832548:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642621568 00000100:00100000:1.0:1783349866.832605:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:1.0:1783349866.832615:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+16:10477:x1869977642621568:12345-192.168.203.50@tcp:101:rm.0 00010000:00010000:1.0:1783349866.832646:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349866.832665:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2298 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece55 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.833337:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e229f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.833352:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e229f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.833362:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e229f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349866.833375:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783349866.833470:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2298 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece55 expref: 19 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.833490:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e229f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece55 expref: 18 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.833499:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea34459ea00) 00010000:00010000:1.0:1783349866.833502:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783349866.833505:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c800, rc 0) 00000100:00100000:1.0:1783349866.833620:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+18:10477:x1869977642621568:12345-192.168.203.50@tcp:101:rm.0 Request processed in 1005us (1237us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783349866.833635:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:1.0:1783349866.836963:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349866.837270:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642621696 00000100:00100000:2.0:1783349866.837280:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642621696 00000100:00100000:2.0:1783349866.837340:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:2.0:1783349866.837351:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+18:10477:x1869977642621696:12345-192.168.203.50@tcp:41:rm.0 00000004:00000024:2.0:1783349866.837404:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1783349866.837473:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+18:10477:x1869977642621696:12345-192.168.203.50@tcp:41:rm.0 Request processed in 123us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349866.837480:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:2.0:1783349866.839811:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349866.839910:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642621824 00000100:00100000:0.0:1783349866.839919:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642621824 00000100:00100000:0.0:1783349866.839974:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:0.0:1783349866.839984:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+18:10477:x1869977642621824:12345-192.168.203.50@tcp:101:rm.0 00010000:00010000:0.0:1783349866.840002:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349866.840022:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e22ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece5c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840093:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e22b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840108:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e22b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840120:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e22b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840130:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e22bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840258:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e22bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840287:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e22bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840372:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e22c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840380:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e22c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840388:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e22c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349866.840422:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783349866.840426:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783349866.840444:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e22c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840455:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e22c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840463:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e22b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840469:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e22b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840475:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e22b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840481:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ec00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349866.840484:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e22b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840499:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e22b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840511:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea34459ea00) 00010000:00010000:0.0:1783349866.840514:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349866.840519:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e22b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840525:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e22b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840539:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e22bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840545:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e22bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840550:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e22bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840555:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349866.840557:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e22bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840563:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e22bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840570:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff8ea2424c5d00) 00010000:00010000:0.0:1783349866.840573:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349866.840575:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e22bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840591:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e22bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840617:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e22ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece5c expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840628:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e22c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece5c expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349866.840635:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ea2427f4300) 00010000:00010000:0.0:1783349866.840637:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349866.840640:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e200, rc 0) 00000100:00100000:0.0:1783349866.841892:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+19:10477:x1869977642621824:12345-192.168.203.50@tcp:101:rm.0 Request processed in 1903us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349866.841902:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:0.0:1783349866.847053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349866.847416:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642622080 00000100:00100000:1.0:1783349866.847426:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642622080 00000100:00100000:1.0:1783349866.847491:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:1.0:1783349866.847501:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+19:10477:x1869977642622080:12345-192.168.203.50@tcp:36:rm.0 00010000:00010000:1.0:1783349866.847571:0:12147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783349866.847597:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e200/0xd05e6ae1590e22c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece5c expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.847619:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e226e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece40 expref: 18 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.847631:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ea2427f4300) 00010000:00010000:1.0:1783349866.847641:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2283 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece47 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.847650:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea34459ea00) 00010000:00010000:1.0:1783349866.847653:0:12147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349866.847673:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e22c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.847690:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e22c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848046:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e22c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848059:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848067:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848072:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848228:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e22d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848238:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e22d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848245:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e22d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349866.848455:0:12147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1783349866.848465:0:12147:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307643328366ns, next at 308643325840ns, rc = 0 00010000:00010000:1.0:1783349866.848508:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848517:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848525:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848533:0:12147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848539:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848544:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848562:0:12147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349866.848580:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e22d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848591:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e22d7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848597:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e22d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848602:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ca00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349866.848605:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e22d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848612:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e22d7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848621:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ea2427f4300) 00010000:00010000:1.0:1783349866.848624:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783349866.848627:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e22d7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848633:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e22d7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848649:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e22c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848660:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e22c9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848666:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e22c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.848670:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349866.848849:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349866.848855:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.848862:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8da00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349866.848865:0:7458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.848871:0:7458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.848879:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ea2427f4300) 00010000:00010000:3.0:1783349866.848882:0:7458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783349866.848884:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.848889:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e22de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.848900:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349866.848902:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349866.848903:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349866.849109:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e22c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.849119:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e22c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.849128:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea34459ea00) 00010000:00010000:1.0:1783349866.849130:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349866.849194:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e22c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.849203:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e22c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349866.849215:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002cc8e6df reply state 0000000040ce7e83 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.849227:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349866.849231:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff8ea2424c5d00) 00010000:00010000:1.0:1783349866.849233:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349866.849235:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349866.849302:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+18:10477:x1869977642622080:12345-192.168.203.50@tcp:36:rm.0 Request processed in 1801us (2255us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783349866.849325:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:1.0:1783349866.853215:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349866.853379:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642622336 00000100:00100000:2.0:1783349866.853389:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642622336 00000100:00100000:2.0:1783349866.853469:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1783349866.853492:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+18:10477:x1869977642622336:12345-192.168.203.50@tcp:35:rm.0 00000100:00100000:2.0:1783349866.853922:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+19:10477:x1869977642622336:12345-192.168.203.50@tcp:35:rm.0 Request processed in 430us (787us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783349866.853930:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1783349866.859657:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349866.859967:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642622592 00000100:00100000:3.0:1783349866.859989:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642622592 00000100:00100000:3.0:1783349866.860051:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:3.0:1783349866.860061:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+19:10477:x1869977642622592:12345-192.168.203.50@tcp:36:rm.0 00010000:00010000:3.0:1783349866.860114:0:8582:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783349866.860258:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e229f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece55 expref: 19 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860283:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e223d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece32 expref: 18 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860294:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea34459ea00) 00010000:00010000:3.0:1783349866.860309:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c400/0xd05e6ae1590e21fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece24 expref: 17 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860318:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea349e98c00) 00010000:00010000:3.0:1783349866.860324:0:8582:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349866.860344:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e22e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860355:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e22e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860362:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e22e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860372:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860378:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860395:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860474:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e22f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860482:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e22f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860489:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e22f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349866.860713:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783349866.860727:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e22f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860734:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e22f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860741:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e22f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860746:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349866.860750:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e22f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860758:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e22f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860766:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ea34459e400) 00010000:00010000:3.0:1783349866.860769:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783349866.860780:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e22f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860786:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd800/0xd05e6ae1590e22f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860802:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e22e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860808:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e22e5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860823:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e22e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860828:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349866.860831:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e22e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860837:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e22e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860844:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea34459e100) 00010000:00010000:3.0:1783349866.860847:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349866.860850:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e22e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860856:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e22e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349866.860866:0:8582:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2b0bcff reply state 000000008d789cc4 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860888:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349866.860894:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ea34459e300) 00010000:00010000:3.0:1783349866.860896:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783349866.860898:0:8582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783349866.861272:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+18:10477:x1869977642622592:12345-192.168.203.50@tcp:36:rm.0 Request processed in 1211us (1623us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783349866.861280:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00010000:00010000:3.0:1783349867.140356:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349867.396301:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659473536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349867.396301:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659473408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349867.396501:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659473664:0@lo:400:kworker.0 00000100:00100000:1.0:1783349867.396643:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659473792:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.396718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.396774:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659474048:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.396802:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.396832:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659474560:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.396855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.396880:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659475072:0@lo:400:kworker.0 00000100:00100000:0.0:1783349867.396887:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.396909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349867.396921:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659473920:0@lo:400:kworker.0 00000100:00100000:0.0:1783349867.396948:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.396949:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659474560 00000100:00100000:2.0:1783349867.396957:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659474560 00000100:00100000:0.0:1783349867.396966:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659474432:0@lo:400:kworker.0 00000100:00100000:0.0:1783349867.397003:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.397008:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659475072 00000100:00100000:2.0:1783349867.397013:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659475072 00000100:00100000:0.0:1783349867.397023:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659474944:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.397041:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783349867.397053:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659474560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349867.397055:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349867.397087:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659473408 00000100:00100000:0.0:1783349867.397102:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659473408 00000100:00100000:2.0:1783349867.397119:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659474560:12345-0@lo:400:kworker.0 Request processed in 67us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.397126:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783349867.397152:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783349867.397165:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783349867.397173:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1869977659475072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.397200:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1869977659475072:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.397222:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783349867.397243:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659473536 00000100:00100000:2.0:1783349867.397246:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659473536 00000100:00100000:2.0:1783349867.397269:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659473920 00000100:00100000:2.0:1783349867.397272:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659473920 00000100:00100000:2.0:1783349867.397282:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783349867.397287:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659473536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783349867.397313:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349867.397346:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659473536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.397351:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783349867.397361:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783349867.397366:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659473920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.397398:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659473920:12345-0@lo:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.397404:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1783349867.397419:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349867.397423:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349867.397425:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659473408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783349867.397441:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1783349867.397459:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cce9880 x1869977659474560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349867.397473:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659473408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.397474:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659474560:0@lo:400:kworker.0 00000100:00100000:0.0:1783349867.397487:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1783349867.397495:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cce9500 x1869977659475072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349867.397504:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659475072:0@lo:400:kworker.0 00000100:00100000:0.0:1783349867.397512:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659474048 00000100:00100000:0.0:1783349867.397517:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659474048 00000100:00100000:2.0:1783349867.397523:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659473536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349867.397551:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659474432 00000100:00100000:0.0:1783349867.397555:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659474432 00000100:00100000:2.0:1783349867.397581:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659473920:0@lo:400:kworker.0 00000100:00100000:0.0:1783349867.397587:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659474944 00000100:00100000:0.0:1783349867.397591:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659474944 00010000:00080000:2.0:1783349867.397596:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f48e300 x1869977659473408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349867.397608:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659473408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349867.397630:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783349867.397637:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659474048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.397674:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659474048:12345-0@lo:400:kworker.0 Request processed in 37us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.397681:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783349867.397690:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783349867.397699:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659474432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.397704:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783349867.397714:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659474944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349867.397748:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659474432:12345-0@lo:400:kworker.0 Request processed in 50us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.397756:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659474944:12345-0@lo:400:kworker.0 Request processed in 43us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349867.397757:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783349867.397769:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1783349867.397786:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783349867.397804:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659474048:0@lo:400:kworker.0 00010000:00080000:0.0:1783349867.397824:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243b2ed80 x1869977659474432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349867.397836:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659474432:0@lo:400:kworker.0 00010000:00080000:0.0:1783349867.397849:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36ccea680 x1869977659474944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349867.397857:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659474944:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.400418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.400467:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659474176:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.400508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.400531:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659474688:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.400556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.400574:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659475200:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.400596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.400633:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659474688 00000100:00100000:2.0:1783349867.400647:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659474688 00000100:00100000:2.0:1783349867.400700:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659475200 00000100:00100000:2.0:1783349867.400705:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659475200 00000100:00100000:1.0:1783349867.400705:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349867.400735:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659474304:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.400738:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783349867.400751:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659474688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349867.400777:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349867.400820:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659474816:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.400834:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659474688:12345-0@lo:400:kworker.0 Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.400843:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783349867.400849:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.400867:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783349867.400872:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659475328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349867.400879:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659475200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349867.400901:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349867.400926:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659475200:12345-0@lo:400:kworker.0 Request processed in 50us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.400934:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783349867.400946:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659473664 00000100:00100000:1.0:1783349867.400952:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659473664 00000100:00080000:2.0:1783349867.400958:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349867.400964:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349867.400979:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659474176 00000100:00100000:2.0:1783349867.400983:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659474176 00000100:00100000:1.0:1783349867.401003:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1783349867.401015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783349867.401025:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659473664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.401026:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659474176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.401061:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659474176:12345-0@lo:400:kworker.0 Request processed in 39us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.401067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783349867.401107:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659474176:0@lo:400:kworker.0 00010000:00080000:2.0:1783349867.401120:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cce9180 x1869977659474688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349867.401130:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659474688:0@lo:400:kworker.0 00010000:00080000:2.0:1783349867.401178:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cceb480 x1869977659475200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349867.401187:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659475200:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.401235:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659473792 00000100:00100000:2.0:1783349867.401239:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659473792 00000100:00100000:2.0:1783349867.401263:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659474304 00000100:00100000:2.0:1783349867.401266:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659474304 00000100:00100000:2.0:1783349867.401302:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659474816 00000100:00100000:2.0:1783349867.401307:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659474816 00000100:00100000:2.0:1783349867.401329:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783349867.401334:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659473664:12345-0@lo:400:kworker.0 Request processed in 310us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.401341:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659473792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349867.401346:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1783349867.401384:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659475328 00000100:00100000:1.0:1783349867.401388:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659475328 00000100:00100000:2.0:1783349867.401394:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659473792:12345-0@lo:400:kworker.0 Request processed in 55us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.401401:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783349867.401419:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783349867.401423:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783349867.401431:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659475328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349867.401436:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659474304:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1783349867.401449:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349867.401471:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659474304:12345-0@lo:400:kworker.0 Request processed in 39us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.401479:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783349867.401494:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659475328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.401497:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783349867.401507:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783349867.401510:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659474816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349867.401548:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659473792:0@lo:400:kworker.0 00000100:00100000:2.0:1783349867.401551:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659474816:12345-0@lo:400:kworker.0 Request processed in 43us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349867.401560:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783349867.401567:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659474304:0@lo:400:kworker.0 00000100:00100000:1.0:1783349867.401580:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659474816:0@lo:400:kworker.0 00000100:00080000:2.0:1783349867.401586:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783349867.401667:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243a0df80 x1869977659475328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349867.401692:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659475328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349867.401728:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659473664:0@lo:400:kworker.0 00010000:00010000:3.0:1783349868.164320:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349868.932445:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349868.932482:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659475584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349868.932502:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659475456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349868.932560:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349868.932591:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659475456 00000100:00100000:2.0:1783349868.932599:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659475456 00000100:00100000:2.0:1783349868.932649:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783349868.932659:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659475456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783349868.932689:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349868.932708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349868.932742:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659475456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349868.932750:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783349868.932756:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659475584 00000100:00100000:0.0:1783349868.932762:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659475584 00010000:00080000:2.0:1783349868.932793:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36ccead80 x1869977659475456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349868.932824:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659475456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349868.932860:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783349868.932870:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659475584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349868.932882:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349868.933631:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659475584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 759us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349868.933641:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1783349868.933701:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370df7b80 x1869977659475584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349868.933717:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659475584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349869.145189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349869.145237:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349869.145268:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349869.145302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349869.145320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349869.145339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349869.145364:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642622720 00000100:00100000:0.0:1783349869.145373:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642622720 00000100:00100000:0.0:1783349869.145419:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 329 00000100:00100000:0.0:1783349869.145428:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642622720:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349869.145494:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642622720:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 66us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349869.145502:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 329 00000100:00100000:1.0:1783349869.145519:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642622848 00000100:00100000:1.0:1783349869.145525:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642622848 00000100:00080000:0.0:1783349869.145565:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349869.145570:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642623360 00000100:00100000:1.0:1783349869.145575:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642623360 00000100:00100000:1.0:1783349869.145610:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642622976 00000100:00100000:1.0:1783349869.145613:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642622976 00000100:00100000:1.0:1783349869.145626:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642623232 00000100:00100000:1.0:1783349869.145629:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642623232 00000100:00100000:1.0:1783349869.145646:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 180 00000100:00100000:1.0:1783349869.145655:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+18:2400:x1869977642622848:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349869.145668:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642623104 00000100:00100000:3.0:1783349869.145674:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642623104 00000100:00100000:1.0:1783349869.145700:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+18:2400:x1869977642622848:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 46us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349869.145708:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:1.0:1783349869.145711:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 180 00000100:00100000:3.0:1783349869.145721:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642623104:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349869.145732:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 181 00000100:00100000:1.0:1783349869.145741:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642623360:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349869.145755:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642623104:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 37us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349869.145763:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:1.0:1783349869.145775:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642623360:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 34us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349869.145785:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 181 00000100:00100000:1.0:1783349869.145813:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 182 00000100:00100000:1.0:1783349869.145820:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642622976:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349869.145829:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 183 00000100:00100000:2.0:1783349869.145843:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642623232:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349869.145866:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642622976:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 45us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349869.145874:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 182 00000100:00100000:2.0:1783349869.145894:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642623232:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 54us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349869.145901:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 183 00000100:00080000:0.0:1783349869.146218:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349869.146222:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783349869.146225:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783349869.189466:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783349869.921501:0:13677:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1783349870.214221:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783349870.714371:0:13725:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd89622630 20000000:00000080:0.0:1783349870.714388:0:13725:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ea243207400 uarg=0000000000000000 20000000:01000000:0.0:1783349870.714461:0:13725:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783349870.714467:0:13725:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783349870.714477:0:13725:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1783349870.716301:0:13726:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1783349870.716503:0:13725:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1783349870.721426:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1783349870.721465:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1783349870.721483:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1783349870.721500:0:13725:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783349870.721517:0:13725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721535:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e2187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece0f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721543:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e218e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece16 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721551:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e219c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2195 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721557:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e21aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e21a3 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721564:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e21b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e21b1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721571:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e21c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e21bf expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721579:0:13725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721617:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e21c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e21bf expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721649:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e21c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e21bf expref: 23 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.721662:0:13725:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659475712:0@lo:104: 00000100:00100000:3.0:1783349870.721726:0:13725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349870.721801:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e21b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e21b1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721809:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e21b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e21b1 expref: 23 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.721818:0:13725:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659475840:0@lo:104: 00010000:00010000:3.0:1783349870.721844:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e21aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e21a3 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721851:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e21aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e21a3 expref: 23 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.721859:0:13725:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659475968:0@lo:104: 00010000:00010000:3.0:1783349870.721884:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e219c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e2195 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721891:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e219c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e2195 expref: 23 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.721899:0:13725:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659476096:0@lo:104: 00010000:00010000:3.0:1783349870.721921:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e218e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece16 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.721941:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e218e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece16 expref: 12 pid: 6510 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.721951:0:13725:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659476224:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349870.722020:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e2187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece0f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.722028:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e2187 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece0f expref: 12 pid: 6510 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.722037:0:13725:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659476352:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349870.722057:0:13725:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349870.722190:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783349870.722208:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349870.722229:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349870.722237:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349870.722244:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659475712 00000100:00100000:0.0:1783349870.722250:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659475712 00000100:00100000:0.0:1783349870.722280:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659475840 00000100:00100000:0.0:1783349870.722283:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659475840 00000100:00100000:0.0:1783349870.722289:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659475968 00000100:00100000:0.0:1783349870.722291:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659475968 00000100:00100000:0.0:1783349870.722297:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659476096 00000100:00100000:0.0:1783349870.722299:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659476096 00000100:00100000:0.0:1783349870.722308:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783349870.722314:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243207c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:13725:x1869977659475712:12345-0@lo:104: 00010000:00010000:0.0:1783349870.722325:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722366:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783349870.722372:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243207c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+6:13725:x1869977659475712:12345-0@lo:104: Request processed in 58us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349870.722378:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783349870.722407:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783349870.722412:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:13725:x1869977659475840:12345-0@lo:104: 00010000:00010000:0.0:1783349870.722418:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722442:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783349870.722446:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+5:13725:x1869977659475840:12345-0@lo:104: Request processed in 35us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349870.722459:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783349870.722470:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783349870.722474:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:13725:x1869977659475968:12345-0@lo:104: 00010000:00010000:0.0:1783349870.722480:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722518:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783349870.722523:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+4:13725:x1869977659475968:12345-0@lo:104: Request processed in 49us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349870.722529:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783349870.722539:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783349870.722543:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:13725:x1869977659476096:12345-0@lo:104: 00010000:00010000:0.0:1783349870.722549:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722567:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783349870.722571:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+3:13725:x1869977659476096:12345-0@lo:104: Request processed in 28us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349870.722577:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1783349870.722589:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783349870.722594:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722600:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d400 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349870.722603:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722620:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349870.722626:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349870.722632:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783349870.722666:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722671:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349870.722690:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722698:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d400/0xd05e6ae1590e21bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e21c6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722710:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783349870.722713:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722718:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349870.722721:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722727:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349870.722733:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349870.722743:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783349870.722756:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722761:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349870.722776:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722793:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e000/0xd05e6ae1590e21b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e21b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722802:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783349870.722805:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722810:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f400 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349870.722813:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722819:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349870.722825:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349870.722831:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783349870.722842:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722848:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349870.722860:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722866:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f400/0xd05e6ae1590e21a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e21aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722874:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349870.722877:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722882:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349870.722884:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722890:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349870.722896:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349870.722906:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783349870.722918:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722923:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349870.722930:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722936:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8d800/0xd05e6ae1590e2195 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e219c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.722947:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349870.722954:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349870.722956:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349870.722963:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349870.722968:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349870.722979:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659476480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349870.724842:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349870.725684:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349870.725698:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659476864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783349870.725718:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659476608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349870.725757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349870.725800:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349870.725809:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659476736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349870.726090:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659476480 00000100:00100000:3.0:1783349870.726099:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659476480 00000100:00100000:2.0:1783349870.726104:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659476864 00000100:00100000:2.0:1783349870.726112:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659476864 00010000:00010000:3.0:1783349870.726132:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e21c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e21bf expref: 25 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.726150:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e219c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e2195 expref: 25 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349870.726182:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659476608 00000100:00100000:2.0:1783349870.726185:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659476608 00010000:00010000:2.0:1783349870.726196:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e21b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e21b1 expref: 26 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349870.726231:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783349870.726240:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+26:3647:x1869977659476864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349870.726253:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349870.726259:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e219c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e2195 expref: 26 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.726306:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783349870.726312:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+26:3648:x1869977659476608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349870.726320:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349870.726324:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e21b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e21b1 expref: 26 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.726333:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e21b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e21b1 expref: 26 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.726351:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349870.726380:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e219c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e2195 expref: 26 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.726388:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+26:3648:x1869977659476608:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349870.726395:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:2.0:1783349870.726401:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349870.726412:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783349870.726419:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+25:3647:x1869977659476480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349870.726426:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349870.726431:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e21c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e21bf expref: 25 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.726441:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e21c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e21bf expref: 25 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349870.726445:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+25:3647:x1869977659476864:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (687us total) trans 0 rc 0/0 00010000:00010000:3.0:1783349870.726455:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349870.726456:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783349870.726479:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659476480:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349870.726486:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1783349870.726529:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e21c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e21bf expref: 23 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.726539:0:13725:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659475712:0@lo:104: 00010000:00010000:3.0:1783349870.726549:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8e400/0xd05e6ae1590e21b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e21b1 expref: 22 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.726556:0:13725:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659475840:0@lo:104: 00000100:00100000:3.0:1783349870.726564:0:13725:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659475968:0@lo:104: 00010000:00010000:3.0:1783349870.726571:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215fe00/0xd05e6ae1590e219c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e2195 expref: 21 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.726579:0:13725:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659476096:0@lo:104: 00000100:00100000:1.0:1783349870.726650:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659476608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349870.726878:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349870.727116:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642623488 00000100:00100000:2.0:1783349870.727122:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642623488 00010000:00010000:2.0:1783349870.727159:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e2187 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece0f expref: 13 pid: 6510 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349870.727184:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:2.0:1783349870.727192:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642623488:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349870.727202:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349870.727207:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e2187 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece0f expref: 13 pid: 6510 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.727216:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e2187 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece0f expref: 13 pid: 6510 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.727240:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349870.727325:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642623488:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 86us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349870.727335:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:1.0:1783349870.727495:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349870.727520:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659476736 00000100:00100000:2.0:1783349870.727526:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659476736 00010000:00010000:2.0:1783349870.727543:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e21aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e21a3 expref: 21 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349870.727569:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783349870.727576:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:3649:x1869977659476736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349870.727585:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783349870.727668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349870.727688:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642623616 00000100:00100000:0.0:1783349870.727691:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642623616 00010000:00010000:0.0:1783349870.727707:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e218e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece16 expref: 13 pid: 6510 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349870.727727:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:0.0:1783349870.727734:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642623616:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349870.727742:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349870.727747:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e218e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece16 expref: 13 pid: 6510 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349870.727755:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e218e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece16 expref: 13 pid: 6510 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.727872:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e218e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece16 expref: 13 pid: 6510 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.727883:0:13725:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659476224:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349870.727892:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e2187 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece0f expref: 12 pid: 6510 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349870.727899:0:13725:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1869977659476352:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349870.727939:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349870.727963:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:2402:x1869977642623616:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 230us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349870.727977:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:0.0:1783349870.728005:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659476864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349870.728028:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659476480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349870.728129:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e21aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e21a3 expref: 21 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.729299:0:13725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729305:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e21aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e21a3 expref: 21 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729441:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e21aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e21a3 expref: 21 pid: 6512 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729457:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729464:0:13183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729482:0:13183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729839:0:13183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729846:0:13183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729853:0:13183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729859:0:13183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783349870.729863:0:13183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729872:0:13183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729893:0:13183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349870.729905:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349870.729973:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:3649:x1869977659476736:12345-0@lo:103:ldlm_bl.0 Request processed in 2396us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349870.729982:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783349870.730060:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659476736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349870.730386:0:13725:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.730395:0:13725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349870.730401:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e22fa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349870.980499:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659476992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349870.980595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349870.980754:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659476992 00000100:00100000:2.0:1783349870.980762:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659476992 00000100:00100000:2.0:1783349870.980819:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783349870.980825:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659476992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783349870.980853:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783349870.980896:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659476992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349870.980912:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783349870.980978:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659476992:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783349871.236856:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783349871.335727:0:13774:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce5692a90 20000000:00000080:1.0:1783349871.336075:0:13774:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ea36e23b800 uarg=0000000000000000 20000000:01000000:1.0:1783349871.336114:0:13774:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1783349871.336121:0:13774:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1783349871.336126:0:13774:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1783349871.336793:0:13775:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1783349871.336940:0:13774:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1783349871.337078:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1783349871.337108:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1783349871.337124:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1783349871.337510:0:13774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783349871.337592:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349871.337608:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349871.337628:0:13774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349871.337636:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349871.337642:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349871.337650:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349871.337656:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349871.337660:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349871.337667:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349871.337678:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349871.337686:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349871.337692:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e2301 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349872.004292:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783349872.004300:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d976000 from 7 10000000:01000000:1.0:1783349872.004305:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783349872.004355:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349872.004367:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349872.004379:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349872.004421:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659477120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783349872.004489:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349872.004544:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cec8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349872.005011:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659477120 00000100:00100000:2.0:1783349872.005020:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659477120 00000100:00100000:2.0:1783349872.005066:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1783349872.005075:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:6514:x1869977659477120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349872.005088:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349872.005102:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e230f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2308 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.005125:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e230f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2308 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.005153:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e230f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2308 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.005163:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341524600, rc 0) 00000100:00100000:2.0:1783349872.005208:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659477120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349872.005216:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1783349872.005477:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659477120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349872.005495:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.005513:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349872.005579:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659477248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349872.005611:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.005636:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349872.005685:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659477248 00000100:00100000:0.0:1783349872.005691:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659477248 00000100:00100000:0.0:1783349872.005721:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1783349872.005728:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659477248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.005850:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659477248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.005857:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1783349872.005930:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659477248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349872.005958:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659477376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349872.006005:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.006031:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349872.006104:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659477376 00000100:00100000:0.0:1783349872.006109:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659477376 00000100:00100000:0.0:1783349872.006312:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1783349872.006320:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659477376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.006408:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659477376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.006415:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1783349872.006607:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659477376:0@lo:503:ll_cfg_requeue.0 00000001:00080000:1.0:1783349872.009685:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1783349872.009704:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1783349872.010010:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010022:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010031:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010039:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349872.010057:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010066:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010084:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff8ea2424c5d00) 00010000:00010000:2.0:1783349872.010087:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349872.010093:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010099:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525e00/0xd05e6ae1590e2252 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010121:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010127:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010133:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010175:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349872.010179:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010185:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010195:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ea2427f4300) 00010000:00010000:2.0:1783349872.010198:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349872.010207:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010213:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2267 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010233:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010240:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010246:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349872.010250:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659477504:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783349872.010253:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349872.010272:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010280:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010289:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff8ea2424c5d00) 00010000:00010000:2.0:1783349872.010292:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349872.010296:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010303:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e22d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349872.010314:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349872.010319:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010338:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010344:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010349:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349872.010352:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010358:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010367:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ea34459e300) 00010000:00010000:2.0:1783349872.010370:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349872.010373:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.010379:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e22ec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349872.010408:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659477504 00000100:00100000:2.0:1783349872.010415:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659477504 00000100:00100000:2.0:1783349872.011322:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349872.011335:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659477504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783349872.011364:0:9981:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1783349872.011396:0:9981:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a4bc269, atime: 0x6a4bc269, ctime: 0x6a4bc269, blocks: 0x0 00010000:00010000:2.0:1783349872.011405:0:9981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2316 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783349872.012956:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349872.014078:0:13787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13787:1869977659477632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349872.014355:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349872.014390:0:13787:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cec8180 going to sleep for 11 seconds 00010000:00010000:2.0:1783349872.014403:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=312s v=(0 0) 00010000:00010000:2.0:1783349872.014409:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349872.014418:0:9981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2316 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.014436:0:9981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2316 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.014447:0:9981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2316 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.014454:0:9981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2316 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349872.014467:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659477632 00000100:00100000:0.0:1783349872.014476:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659477632 00010000:00010000:2.0:1783349872.014482:0:9981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783349872.014534:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1783349872.014544:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:13787:x1869977659477632:12345-0@lo:502:llog_process_th.0 00010000:00010000:3.0:1783349872.014657:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349872.014663:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2316 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.014673:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349872.014678:0:7458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2316 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.014687:0:7458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2316 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.014705:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2316 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.014711:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2316 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.014740:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349872.014742:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349872.014744:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349872.018523:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:13787:x1869977659477632:12345-0@lo:502:llog_process_th.0 Request processed in 3972us (4160us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.018537:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1783349872.020559:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659477504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9221us (10238us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783349872.020573:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1783349872.021045:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea2438bb480/2, rc 0, transno 4294967301 00000100:00100000:0.0:1783349872.021054:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659477504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783349872.021393:0:13787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13787:1869977659477632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783349872.021436:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349872.021446:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349872.021448:0:13787:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783349872.021455:0:13787:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea36d976000 00000020:00000080:1.0:1783349872.021459:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783349872.021570:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349872.021575:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349872.021576:0:13787:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783349872.021579:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349872.021582:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349872.021583:0:13787:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783349872.021587:0:13787:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea36d976000 00000020:00000080:1.0:1783349872.021589:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783349872.023318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349872.024500:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642623744 00000100:00100000:0.0:1783349872.024512:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642623744 00000100:00100000:0.0:1783349872.024578:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 334 00000100:00100000:0.0:1783349872.024590:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:6167:x1869977642623744:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349872.024608:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349872.024624:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e231d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece63 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.024650:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e231d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece63 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.024661:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e231d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece63 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.024670:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8fe00, rc 0) 00000100:00100000:0.0:1783349872.024733:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642623744:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 146us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.024740:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 334 00000100:00100000:2.0:1783349872.030416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349872.030971:0:13787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13787:1869977659477760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349872.031029:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349872.035948:0:13787:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cec8180 going to sleep for 11 seconds 00000100:00100000:0.0:1783349872.037848:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642623872 00000100:00100000:3.0:1783349872.037849:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659477760 00000100:00100000:3.0:1783349872.037862:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659477760 00000100:00100000:0.0:1783349872.037862:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642623872 00000100:00100000:0.0:1783349872.037936:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 335 00000100:00100000:0.0:1783349872.037945:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642623872:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.038095:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642623872:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 150us (7687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.038103:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 335 00000100:00100000:0.0:1783349872.038132:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1783349872.039650:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:13787:x1869977659477760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349872.039817:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:13787:x1869977659477760:12345-0@lo:502:llog_process_th.0 Request processed in 184us (8787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.039826:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1783349872.040367:0:13787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13787:1869977659477760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783349872.040403:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349872.040411:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349872.040414:0:13787:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783349872.040418:0:13787:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783349872.043385:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783349872.043420:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783349872.043432:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.043444:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349872.043456:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783349872.043459:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea36d918000 from 7 10000000:01000000:3.0:1783349872.043462:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349872.043498:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.043506:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.043516:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349872.043541:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659477888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783349872.043605:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.044082:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349872.044257:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659477888 00000100:00100000:0.0:1783349872.044266:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659477888 00000100:00100000:0.0:1783349872.044303:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1783349872.044312:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:6514:x1869977659477888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349872.044326:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349872.044341:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e232b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2324 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.044366:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e232b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2324 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.044377:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e232b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2324 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.044387:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f800, rc 0) 00000100:00100000:3.0:1783349872.044435:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349872.044446:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659477888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349872.044457:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642624000 00000100:00100000:3.0:1783349872.044463:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642624000 00000100:00100000:0.0:1783349872.044467:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1783349872.044490:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 338 00000100:00100000:3.0:1783349872.044500:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642624000:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.044518:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659477888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349872.044533:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.044543:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349872.044601:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642624000:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 102us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.044611:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659478016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349872.044612:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 338 00000100:00100000:0.0:1783349872.044643:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349872.044664:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349872.044675:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659478016 00000100:00100000:0.0:1783349872.044679:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659478016 00000040:00080000:2.0:1783349872.048111:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783349872.051345:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1783349872.051369:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659478016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.051533:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659478016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (6888us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.051541:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1783349872.051597:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659478016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.051662:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659478144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.051715:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349872.051749:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349872.051865:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659478144 00000100:00100000:1.0:1783349872.051872:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659478144 00000100:00100000:1.0:1783349872.051906:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1783349872.051913:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659478144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349872.051995:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659478144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.052002:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1783349872.052109:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659478144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.052413:0:13791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13791:1869977659478272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349872.052461:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349872.052481:0:13791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349872.053243:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659478272 00000100:00100000:1.0:1783349872.053251:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659478272 00000100:00100000:1.0:1783349872.053299:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783349872.053308:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:13791:x1869977659478272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349872.053414:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:13791:x1869977659478272:12345-0@lo:502:llog_process_th.0 Request processed in 106us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.053420:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1783349872.053514:0:13791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13791:1869977659478272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349872.053548:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349872.053556:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349872.053558:0:13791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783349872.053565:0:13791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea36d918000 00000020:00000080:0.0:1783349872.053568:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783349872.053627:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349872.053631:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349872.053633:0:13791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783349872.053636:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349872.053638:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349872.053640:0:13791:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783349872.053643:0:13791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea36d918000 00000020:00000080:0.0:1783349872.053645:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783349872.053681:0:13791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13791:1869977659478400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349872.053721:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349872.053748:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659478400 00000100:00100000:0.0:1783349872.053752:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659478400 00000100:00100000:0.0:1783349872.053790:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1783349872.053796:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:13791:x1869977659478400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349872.053871:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:13791:x1869977659478400:12345-0@lo:502:llog_process_th.0 Request processed in 75us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.053878:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1783349872.053919:0:13791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427419c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349872.053931:0:13791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13791:1869977659478400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349872.053950:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349872.053958:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349872.053960:0:13791:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783349872.053963:0:13791:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783349872.054018:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1783349872.054038:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349872.054047:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.054057:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349872.054068:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349872.054070:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea357ed9800 from 7 10000000:01000000:0.0:1783349872.054073:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349872.054095:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.054104:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.054112:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349872.054125:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659478528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.054888:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349872.054966:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427419c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349872.055058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349872.055116:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659478528 00000100:00100000:2.0:1783349872.055123:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659478528 00000100:00100000:2.0:1783349872.055198:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642624128 00000100:00100000:2.0:1783349872.055201:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642624128 00000100:00100000:2.0:1783349872.055219:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1783349872.055227:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:6514:x1869977659478528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349872.055250:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349872.055264:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea341525e00/0xd05e6ae1590e2339 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2332 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.055290:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea341525e00/0xd05e6ae1590e2339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2332 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.055303:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea341525e00/0xd05e6ae1590e2339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2332 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.055311:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341525e00, rc 0) 00000100:00100000:2.0:1783349872.055350:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659478528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349872.055356:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1783349872.055381:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 344 00000100:00100000:2.0:1783349872.055387:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:10761:x1869977642624128:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783349872.055483:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:10761:x1869977642624128:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 95us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349872.055490:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 344 00000100:00100000:0.0:1783349872.056574:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659478528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349872.056599:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.056622:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349872.056709:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659478656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.056751:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349872.056797:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349872.056863:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659478656 00000100:00100000:1.0:1783349872.056869:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659478656 00000100:00100000:1.0:1783349872.056912:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783349872.056920:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659478656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349872.057021:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659478656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.057028:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1783349872.057095:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659478656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.057126:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659478784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.057204:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349872.057222:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427419c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349872.057240:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659478784 00000100:00100000:0.0:1783349872.057244:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659478784 00000100:00100000:0.0:1783349872.057274:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1783349872.057281:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659478784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.057361:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659478784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.057367:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1783349872.057625:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659478784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.058101:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349872.058366:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642624256 00000100:00100000:3.0:1783349872.058373:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642624256 00000100:00100000:3.0:1783349872.058409:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 347 00000100:00100000:3.0:1783349872.058417:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:10761:x1869977642624256:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783349872.058515:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:10761:x1869977642624256:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 99us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349872.058522:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 347 00000100:00100000:2.0:1783349872.060239:0:13792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13792:1869977659478912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349872.060310:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349872.060347:0:13792:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a48900 going to sleep for 11 seconds 00000100:00100000:0.0:1783349872.060470:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659478912 00000100:00100000:0.0:1783349872.060476:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659478912 00000100:00100000:0.0:1783349872.060516:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1783349872.060524:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:13792:x1869977659478912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349872.060625:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:13792:x1869977659478912:12345-0@lo:502:llog_process_th.0 Request processed in 100us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.060641:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1783349872.060752:0:13792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13792:1869977659478912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349872.060790:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349872.060800:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349872.060802:0:13792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783349872.060815:0:13792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea357ed9800 00000020:00000080:2.0:1783349872.060817:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783349872.060876:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349872.060881:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349872.060883:0:13792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783349872.060886:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349872.060889:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349872.060891:0:13792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783349872.060895:0:13792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea357ed9800 00000020:00000080:2.0:1783349872.060897:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783349872.060934:0:13792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13792:1869977659479040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349872.060970:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349872.060988:0:13792:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a48900 going to sleep for 11 seconds 00000100:00100000:0.0:1783349872.061035:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659479040 00000100:00100000:0.0:1783349872.061040:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659479040 00000100:00100000:3.0:1783349872.062897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349872.063022:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642624384 00000100:00100000:0.0:1783349872.063031:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642624384 00000100:00100000:0.0:1783349872.063066:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1783349872.063075:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:13792:x1869977659479040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349872.063249:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 350 00000100:00100000:3.0:1783349872.063260:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:6167:x1869977642624384:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349872.063270:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349872.063287:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e2340 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece6a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.063311:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e2340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece6a expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.063330:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e2340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece6a expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349872.063339:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd000, rc 0) 00000100:00100000:3.0:1783349872.063393:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:6167:x1869977642624384:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 135us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349872.063401:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 350 00000100:00100000:0.0:1783349872.064424:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:13792:x1869977659479040:12345-0@lo:502:llog_process_th.0 Request processed in 1346us (3448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.064435:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1783349872.064666:0:13792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13792:1869977659479040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349872.064701:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349872.064709:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349872.064711:0:13792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783349872.064716:0:13792:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783349872.064986:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1783349872.065020:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349872.065031:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.065041:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349872.065051:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349872.065053:0:6514:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea3461c1000 from 7 10000000:01000000:0.0:1783349872.065057:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349872.065085:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.065093:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.065101:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349872.065130:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659479168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.065199:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349872.065231:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427416c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349872.065558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659479168 00000100:00100000:1.0:1783349872.065571:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659479168 00000100:00100000:1.0:1783349872.065649:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1783349872.065659:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:6514:x1869977659479168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349872.065671:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349872.065683:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e234e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e2347 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349872.065705:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e234e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e2347 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349872.065715:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e234e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e2347 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349872.065724:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c400, rc 0) 00000100:00100000:1.0:1783349872.065766:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659479168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.065783:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1783349872.065810:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659479168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349872.065823:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349872.065832:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349872.065899:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659479296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.065926:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349872.065986:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427416c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349872.066296:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659479296 00000100:00100000:2.0:1783349872.066301:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659479296 00000100:00100000:2.0:1783349872.066366:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1783349872.066376:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659479296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349872.066492:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659479296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349872.066499:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1783349872.066582:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659479296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349872.066622:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659479424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349872.066663:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349872.070568:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351466840 going to sleep for 11 seconds 00000040:00080000:3.0:1783349872.076328:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783349872.076506:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349872.076594:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642624512 00000100:00100000:3.0:1783349872.076603:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642624512 00000100:00100000:3.0:1783349872.076751:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 353 00000100:00100000:3.0:1783349872.076837:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:6167:x1869977642624512:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349872.077215:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:6167:x1869977642624512:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 381us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349872.077225:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 353 00000100:00100000:0.0:1783349872.080251:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659479424 00000100:00100000:0.0:1783349872.080266:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659479424 00000100:00100000:0.0:1783349872.080362:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1783349872.080373:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659479424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349872.080539:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:6514:x1869977659479424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (13875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.080547:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783349872.080662:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:6514:1869977659479424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349872.083479:0:13795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13795:1869977659479552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349872.083563:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.083608:0:13795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393a840 going to sleep for 11 seconds 00000100:00100000:2.0:1783349872.083814:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659479552 00000100:00100000:2.0:1783349872.083823:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659479552 00000100:00100000:2.0:1783349872.083875:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1783349872.083890:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:13795:x1869977659479552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349872.084010:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:13795:x1869977659479552:12345-0@lo:502:llog_process_th.0 Request processed in 121us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349872.084017:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1783349872.084154:0:13795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13795:1869977659479552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783349872.084185:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349872.084194:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349872.084196:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783349872.084203:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea3461c1000 00000020:00000080:3.0:1783349872.084212:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783349872.084219:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000020:01000000:3.0:1783349872.084276:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349872.084280:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349872.084281:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783349872.084284:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349872.084287:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349872.084289:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783349872.084293:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea3461c1000 00000020:00000080:3.0:1783349872.084295:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783349872.084336:0:13795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13795:1869977659479680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349872.084373:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.084394:0:13795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393a840 going to sleep for 11 seconds 00000100:00100000:2.0:1783349872.084659:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642624640 00000100:00100000:2.0:1783349872.084664:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642624640 00000100:00100000:2.0:1783349872.084692:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659479680 00000100:00100000:2.0:1783349872.084696:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659479680 00000100:00100000:2.0:1783349872.084711:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 356 00000100:00100000:2.0:1783349872.084717:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:6167:x1869977642624640:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349872.084812:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:6167:x1869977642624640:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 93us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349872.084820:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 356 00000100:00100000:2.0:1783349872.084840:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1783349872.084846:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:13795:x1869977659479680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349872.084923:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:13795:x1869977659479680:12345-0@lo:502:llog_process_th.0 Request processed in 76us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349872.084930:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1783349872.088552:0:13795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:13795:1869977659479680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783349872.091086:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349872.091103:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349872.091105:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783349872.091110:0:13795:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1783349872.091217:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1783349872.091248:0:6514:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783349872.091260:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349872.091272:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349872.097594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349872.097846:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642624768 00000100:00100000:0.0:1783349872.097855:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642624768 00000100:00100000:0.0:1783349872.097910:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 358 00000100:00100000:0.0:1783349872.097923:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:10765:x1869977642624768:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783349872.098094:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:10765:x1869977642624768:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 173us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.098102:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 358 00000100:00100000:2.0:1783349872.110883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349872.110948:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642624896 00000100:00100000:1.0:1783349872.110971:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642624896 00000100:00100000:1.0:1783349872.111039:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 359 00000100:00100000:1.0:1783349872.111050:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:10765:x1869977642624896:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349872.111224:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:10765:x1869977642624896:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 176us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.111233:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 359 00010000:00010000:0.0:1783349872.261837:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349872.517365:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659480064:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.517433:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.517484:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659480576:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.517505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.517525:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659481088:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.517545:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.517565:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1783349872.517572:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659479936:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.517598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.517617:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659480448:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.517640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.517654:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659480960:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.517675:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.517692:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659481472:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.517711:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.517755:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659480960 00000100:00100000:3.0:1783349872.517763:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659480960 00000100:00100000:3.0:1783349872.517813:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659481472 00000100:00100000:3.0:1783349872.517816:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659481472 00000100:00100000:3.0:1783349872.517834:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783349872.517843:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659480960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.517895:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659480960:12345-0@lo:400:kworker.0 Request processed in 53us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349872.517903:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783349872.517919:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783349872.517925:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1869977659481472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.517950:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1869977659481472:12345-0@lo:400:kworker.0 Request processed in 26us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349872.517956:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783349872.518165:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659480064 00000100:00100000:1.0:1783349872.518169:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659480064 00000100:00100000:1.0:1783349872.518194:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659480576 00000100:00100000:1.0:1783349872.518197:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659480576 00000100:00100000:1.0:1783349872.518212:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659481088 00000100:00100000:1.0:1783349872.518214:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659481088 00000100:00100000:1.0:1783349872.518241:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783349872.518248:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659480064:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783349872.518308:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cceb480 x1869977659480960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349872.518322:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659480960:0@lo:400:kworker.0 00000100:00100000:0.0:1783349872.518367:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659479808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349872.518441:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659480192:0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.522016:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659480064:12345-0@lo:400:kworker.0 Request processed in 3696us (4510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.522030:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783349872.522069:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783349872.522081:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659480576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.522132:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659480576:12345-0@lo:400:kworker.0 Request processed in 57us (4626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.522361:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783349872.522378:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783349872.522387:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659481088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.522421:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659481088:12345-0@lo:400:kworker.0 Request processed in 36us (4875us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.522426:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1783349872.522493:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349872.522499:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349872.522502:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659481472:0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.522512:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659479936 00000100:00100000:1.0:1783349872.522521:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659479936 00000100:00100000:3.0:1783349872.522522:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659480064:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.522538:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659480576:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.522551:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659481088:0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.522572:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1783349872.522581:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659479936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.522624:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659480448 00000100:00100000:1.0:1783349872.522626:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659479936:12345-0@lo:400:kworker.0 Request processed in 46us (5027us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349872.522629:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659480448 00000100:00100000:1.0:1783349872.522636:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783349872.522667:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783349872.522677:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659480448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.522679:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659479936:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.522737:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659480448:12345-0@lo:400:kworker.0 Request processed in 62us (5094us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.522743:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349872.522745:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783349872.522759:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659481600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349872.522871:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349872.522914:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659480448:0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.522935:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659481600 00000100:00100000:3.0:1783349872.522940:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659481600 00000100:00100000:3.0:1783349872.522974:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783349872.522981:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659481600:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783349872.523032:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1783349872.523327:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349872.523363:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659481600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 382us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349872.523369:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783349872.523509:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659481600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349872.526245:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349872.527082:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659480320:0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.527128:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349872.527178:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659480832:0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.527203:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349872.527234:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659480832 00000100:00100000:1.0:1783349872.527242:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659480832 00000100:00100000:1.0:1783349872.527296:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783349872.527305:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659480832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.527353:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659480832:12345-0@lo:400:kworker.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.527373:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1783349872.527397:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783349872.527424:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cceb800 x1869977659480832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349872.527453:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659480832:0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.527460:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659481344:0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.527495:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349872.527516:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659481344 00000100:00100000:1.0:1783349872.527519:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659481344 00000100:00100000:1.0:1783349872.527544:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783349872.527551:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659481344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.527581:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659481344:12345-0@lo:400:kworker.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.527587:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783349872.527616:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659481344:0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.527638:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349872.527644:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659481728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783349872.527667:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349872.527707:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659481728 00000100:00100000:1.0:1783349872.527710:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659481728 00000100:00100000:1.0:1783349872.527735:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783349872.527741:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659481728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783349872.527767:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783349872.527827:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659481728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349872.527842:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783349872.527889:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659481728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349872.527928:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659479808 00000100:00100000:0.0:1783349872.527935:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659479808 00000100:00100000:0.0:1783349872.528081:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783349872.528091:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659479808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349872.528108:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349872.528160:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659479808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.528166:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783349872.528197:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659479808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349872.528359:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659480320 00000100:00100000:3.0:1783349872.528364:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659480320 00000100:00100000:3.0:1783349872.528405:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783349872.528411:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659480320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.528711:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659480320:12345-0@lo:400:kworker.0 Request processed in 299us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349872.528718:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1783349872.528781:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659480320:0@lo:400:kworker.0 00000100:00100000:2.0:1783349872.529105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349872.529151:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659480704:0@lo:400:kworker.0 00000100:00100000:2.0:1783349872.529178:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349872.529209:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659481216:0@lo:400:kworker.0 00000100:00100000:2.0:1783349872.529240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349872.529442:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659480192 00000100:00100000:3.0:1783349872.529448:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659480192 00000100:00100000:3.0:1783349872.529487:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783349872.529494:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659480192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349872.529535:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659480192:12345-0@lo:400:kworker.0 Request processed in 41us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349872.529541:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783349872.529599:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659480704 00000100:00100000:1.0:1783349872.529604:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659480704 00000100:00100000:0.0:1783349872.529611:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659481216 00000100:00100000:0.0:1783349872.529616:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659481216 00000100:00100000:1.0:1783349872.529652:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783349872.529660:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659480704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349872.529677:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659480192:0@lo:400:kworker.0 00000100:00100000:1.0:1783349872.529702:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659480704:12345-0@lo:400:kworker.0 Request processed in 43us (521us total) trans 0 rc 0/0 00010000:00080000:2.0:1783349872.529704:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36ccead80 x1869977659480704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349872.529714:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1783349872.529723:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659480704:0@lo:400:kworker.0 00000100:00100000:0.0:1783349872.530111:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1783349872.530119:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659481216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349872.530224:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659481216:12345-0@lo:400:kworker.0 Request processed in 106us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349872.530241:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:3.0:1783349872.530400:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1783349872.530467:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36ccea680 x1869977659481216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349872.530478:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659481216:0@lo:400:kworker.0 00000040:00080000:3.0:1783349873.093071:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783349873.093989:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783349873.284851:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349874.053046:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659481856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349874.053103:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659481984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349874.053127:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349874.053226:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659481856 00000100:00100000:3.0:1783349874.053232:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659481856 00000100:00100000:3.0:1783349874.053288:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783349874.053296:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659481856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783349874.053323:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783349874.053333:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349874.053390:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659481856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349874.053397:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783349874.053408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349874.053433:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659481984 00000100:00100000:3.0:1783349874.053436:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659481984 00000100:00100000:3.0:1783349874.053460:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783349874.053464:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659481984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783349874.053472:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349874.053496:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659481984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349874.053502:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1783349874.053530:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36db7df80 x1869977659481984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349874.053549:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659481984:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783349874.053793:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783349874.053813:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2437ff800 x1869977659481856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349874.053826:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659481856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349874.269169:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349874.269210:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349874.269233:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349874.269257:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349874.269275:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349874.269299:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349874.269337:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642625408 00000100:00100000:1.0:1783349874.269347:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642625408 00000100:00100000:1.0:1783349874.269402:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:1.0:1783349874.269411:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642625408:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349874.269472:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642625408:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 63us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349874.269480:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:2.0:1783349874.269979:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642625280 00000100:00100000:2.0:1783349874.269984:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642625280 00000100:00100000:2.0:1783349874.270018:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642625536 00000100:00100000:2.0:1783349874.270031:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642625536 00000100:00100000:2.0:1783349874.270043:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642625152 00000100:00100000:2.0:1783349874.270045:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642625152 00000100:00100000:2.0:1783349874.270055:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642625664 00000100:00100000:2.0:1783349874.270057:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642625664 00000100:00100000:2.0:1783349874.270069:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 190 00000100:00100000:2.0:1783349874.270075:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642625280:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349874.270112:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642625280:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 38us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349874.270118:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 190 00000100:00100000:2.0:1783349874.270128:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 191 00000100:00100000:2.0:1783349874.270134:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642625536:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349874.270182:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642625536:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 48us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349874.270188:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 191 00000100:00100000:2.0:1783349874.270199:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 192 00000100:00100000:2.0:1783349874.270205:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642625152:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349874.270226:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642625152:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 21us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349874.270232:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 192 00000100:00100000:2.0:1783349874.270242:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 193 00000100:00100000:2.0:1783349874.270248:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642625664:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349874.270270:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642625664:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349874.270275:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 193 00000100:00100000:0.0:1783349874.270769:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642625024 00000100:00100000:0.0:1783349874.270776:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642625024 00000100:00100000:0.0:1783349874.270820:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 361 00000100:00100000:0.0:1783349874.270828:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642625024:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349874.270870:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642625024:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 43us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349874.270877:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 361 00000100:00080000:0.0:1783349874.270910:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783349874.271047:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349874.271051:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783349874.309905:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349875.332508:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349876.103047:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349876.103070:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659482112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783349876.103133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349876.103600:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659482112 00000100:00100000:0.0:1783349876.103609:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659482112 00000100:00100000:0.0:1783349876.103847:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783349876.103859:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659482112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783349876.103957:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783349876.104022:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659482112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349876.104248:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659482112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349876.105935:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:3.0:1783349876.359616:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349877.380354:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349877.636509:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659482624:0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.636570:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659482496:0@lo:400:kworker.0 00000100:00100000:2.0:1783349877.636580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349877.636640:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659482368:0@lo:400:kworker.0 00000100:00100000:3.0:1783349877.636719:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659482240:0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.636838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349877.636895:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659483008:0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.636949:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349877.636972:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659483520:0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.637017:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349877.637043:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659484032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349877.637079:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349877.637107:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349877.637113:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659484160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783349877.637157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349877.637194:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659482624 00000100:00100000:1.0:1783349877.637201:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659482624 00000100:00100000:1.0:1783349877.637245:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659483008 00000100:00100000:1.0:1783349877.637248:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659483008 00000100:00100000:1.0:1783349877.637286:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659483520 00000100:00100000:1.0:1783349877.637290:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659483520 00000100:00100000:1.0:1783349877.637307:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1783349877.637365:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659482624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.637414:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659482624:12345-0@lo:400:kworker.0 Request processed in 51us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.637421:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1783349877.637438:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1783349877.637456:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659483008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.637503:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659483008:12345-0@lo:400:kworker.0 Request processed in 37us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.637510:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1783349877.637522:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783349877.637528:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659483520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.637569:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659483520:12345-0@lo:400:kworker.0 Request processed in 41us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.637576:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783349877.637594:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659482496 00000100:00100000:1.0:1783349877.637598:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659482496 00000100:00100000:1.0:1783349877.637620:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659484160 00000100:00100000:1.0:1783349877.637623:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659484160 00000100:00100000:1.0:1783349877.637635:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783349877.637640:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659482496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.637670:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659482496:12345-0@lo:400:kworker.0 Request processed in 29us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.637676:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783349877.637687:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783349877.637693:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659484160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783349877.637739:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783349877.637782:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659484160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.637788:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783349877.637825:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659484160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783349877.637838:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659482496:0@lo:400:kworker.0 00010000:00080000:1.0:1783349877.637850:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da5f80 x1869977659483008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349877.637860:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659483008:0@lo:400:kworker.0 00010000:00080000:1.0:1783349877.637870:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243202d80 x1869977659483520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349877.637891:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659483520:0@lo:400:kworker.0 00000100:00080000:1.0:1783349877.637932:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783349877.637968:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659484032 00000100:00100000:1.0:1783349877.637972:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659484032 00000100:00100000:0.0:1783349877.638014:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349877.638022:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783349877.638030:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659484032:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349877.638046:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659482880:0@lo:400:kworker.0 00002000:00000024:1.0:1783349877.638049:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349877.638094:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659484032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.638100:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783349877.638116:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659482368 00000100:00100000:1.0:1783349877.638119:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659482368 00000100:00100000:1.0:1783349877.638163:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783349877.638171:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659482368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349877.638178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349877.638209:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659482368:12345-0@lo:400:kworker.0 Request processed in 39us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.638215:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783349877.638224:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659482880 00000100:00100000:1.0:1783349877.638227:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659482880 00000100:00100000:1.0:1783349877.638242:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1783349877.638248:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659482880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.638275:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659482880:12345-0@lo:400:kworker.0 Request processed in 27us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.638280:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1783349877.638296:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349877.638299:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349877.638326:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659484032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349877.639058:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659482880:0@lo:400:kworker.0 00000100:00100000:0.0:1783349877.639069:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659483392:0@lo:400:kworker.0 00000100:00100000:0.0:1783349877.639390:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349877.639415:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659483904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349877.639439:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349877.639481:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659482368:0@lo:400:kworker.0 00000100:00100000:0.0:1783349877.639505:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659483904 00000100:00100000:0.0:1783349877.639510:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659483904 00000100:00100000:0.0:1783349877.639549:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783349877.639556:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659483904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349877.639573:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349877.639605:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659483904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349877.639612:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1783349877.639627:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349877.639648:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659483904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349877.639867:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659482624:0@lo:400:kworker.0 00000100:00100000:2.0:1783349877.639876:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659483136:0@lo:400:kworker.0 00000100:00100000:2.0:1783349877.639903:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349877.640245:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659483648:0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.640265:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659483392 00000100:00100000:2.0:1783349877.640275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349877.640317:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659483392 00000100:00100000:3.0:1783349877.640380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349877.640408:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659482240 00000100:00100000:3.0:1783349877.640412:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659482240 00000100:00100000:0.0:1783349877.640423:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659483136 00000100:00100000:1.0:1783349877.640427:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783349877.640430:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659483136 00000100:00100000:3.0:1783349877.640447:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1783349877.640448:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659483392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349877.640469:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659482240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.640517:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659483392:12345-0@lo:400:kworker.0 Request processed in 81us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349877.640520:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659482240:12345-0@lo:400:kworker.0 Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.640529:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1783349877.640533:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1783349877.640553:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659483648 00000100:00100000:1.0:1783349877.640559:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659483648 00000100:00100000:1.0:1783349877.640590:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783349877.640592:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659482240:0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.640600:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659483648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349877.640604:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659482752:0@lo:400:kworker.0 00000100:00100000:3.0:1783349877.640643:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349877.640648:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659483648:12345-0@lo:400:kworker.0 Request processed in 49us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.640655:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783349877.640672:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659482752 00000100:00100000:3.0:1783349877.640677:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659482752 00000100:00100000:3.0:1783349877.640707:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783349877.640712:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659483392:0@lo:400:kworker.0 00000100:00100000:3.0:1783349877.640717:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659482752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349877.640766:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659482752:12345-0@lo:400:kworker.0 Request processed in 51us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349877.640773:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783349877.640798:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659482752:0@lo:400:kworker.0 00000100:00100000:3.0:1783349877.640805:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659483264:0@lo:400:kworker.0 00000100:00100000:3.0:1783349877.640824:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349877.640897:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659483776:0@lo:400:kworker.0 00000100:00100000:3.0:1783349877.641000:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783349877.641051:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349877.641057:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349877.641080:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659483648:0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.641561:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659483264 00000100:00100000:1.0:1783349877.641568:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659483264 00000100:00100000:1.0:1783349877.641610:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659483776 00000100:00100000:1.0:1783349877.641613:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659483776 00000100:00100000:1.0:1783349877.641626:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783349877.641632:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659483264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.641672:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659483264:12345-0@lo:400:kworker.0 Request processed in 40us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.641679:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783349877.641690:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783349877.641696:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659483776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349877.641747:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659483776:12345-0@lo:400:kworker.0 Request processed in 51us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349877.641753:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1783349877.642265:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783349877.644254:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243203480 x1869977659483264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349877.644272:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659483264:0@lo:400:kworker.0 00000100:00100000:3.0:1783349877.644286:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659483776:0@lo:400:kworker.0 00000100:00100000:0.0:1783349877.645905:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783349877.645923:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659483136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349877.646030:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659483136:12345-0@lo:400:kworker.0 Request processed in 114us (6125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349877.646037:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1783349877.646130:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da7800 x1869977659483136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349877.646159:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659483136:0@lo:400:kworker.0 00000001:00080000:1.0:1783349878.149811:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1783349878.408802:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349879.173165:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659484288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349879.173241:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349879.173317:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783349879.173324:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659484416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349879.173358:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349879.173599:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659484288 00000100:00100000:2.0:1783349879.173607:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659484288 00000100:00100000:2.0:1783349879.173661:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659484416 00000100:00100000:2.0:1783349879.173664:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659484416 00000100:00100000:2.0:1783349879.173680:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783349879.173689:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659484288:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349879.173708:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783349879.173730:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659484416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783349879.173767:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1783349879.173768:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349879.173824:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659484416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349879.173831:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1783349879.173847:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349879.174046:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659484288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 357us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349879.174054:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1783349879.174303:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36ccebb80 x1869977659484416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349879.174321:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659484416:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1783349879.174333:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243201880 x1869977659484288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349879.174419:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659484288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349879.384022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349879.384070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349879.384187:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642625792 00000100:00100000:1.0:1783349879.384198:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642625792 00000100:00100000:1.0:1783349879.384256:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 363 00000100:00100000:1.0:1783349879.384266:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642625792:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349879.384343:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642625792:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349879.384351:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 363 00000100:00100000:3.0:1783349879.384427:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642625920 00000100:00100000:3.0:1783349879.384433:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642625920 00000100:00100000:3.0:1783349879.384491:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 200 00000100:00100000:3.0:1783349879.384499:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642625920:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349879.384537:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642625920:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 39us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349879.384544:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 200 00000100:00080000:0.0:1783349879.384612:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349879.392999:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349879.393041:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349879.393167:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642626176 00000100:00100000:1.0:1783349879.393178:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642626176 00000100:00100000:2.0:1783349879.393183:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349879.393252:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00100000:1.0:1783349879.393264:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642626176:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349879.393340:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642626176:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 78us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349879.393347:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00100000:0.0:1783349879.393549:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642626432 00000100:00100000:0.0:1783349879.393554:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642626432 00000100:00100000:0.0:1783349879.393594:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642626048 00000100:00100000:0.0:1783349879.393597:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642626048 00000100:00100000:0.0:1783349879.393622:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 201 00000100:00100000:0.0:1783349879.393629:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642626432:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349879.393669:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642626432:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 39us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349879.393676:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 201 00000100:00100000:0.0:1783349879.393689:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 202 00000100:00100000:0.0:1783349879.393695:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642626048:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349879.393736:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642626048:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 41us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349879.393750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 202 00000100:00080000:0.0:1783349879.393771:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349879.393775:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349879.396846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349879.397122:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642626304 00000100:00100000:3.0:1783349879.397132:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642626304 00000100:00100000:3.0:1783349879.397251:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 203 00000100:00100000:3.0:1783349879.397263:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642626304:12345-192.168.203.50@tcp:400:kworker.0 00000100:00080000:0.0:1783349879.397301:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349879.397340:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642626304:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 79us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349879.397347:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 203 00010000:00010000:3.0:1783349879.428353:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349880.452649:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349881.220676:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349881.220699:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659484544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783349881.220780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349881.221384:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659484544 00000100:00100000:2.0:1783349881.221393:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659484544 00000100:00100000:2.0:1783349881.221457:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783349881.221467:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659484544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783349881.221500:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783349881.221587:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659484544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349881.221593:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783349881.221758:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659484544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783349881.477035:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349882.504354:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349882.756425:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659484928:0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.756494:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349882.756547:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659485440:0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.756572:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349882.756666:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659485952:0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.756702:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.756951:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659484672:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.756988:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.757019:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659484928 00000100:00100000:3.0:1783349882.757027:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659484928 00000100:00100000:3.0:1783349882.757075:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783349882.757084:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659484928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.757128:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659484928:12345-0@lo:400:kworker.0 Request processed in 45us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349882.757177:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783349882.757200:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659484672 00000100:00100000:3.0:1783349882.757203:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659484672 00000100:00100000:3.0:1783349882.757229:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1783349882.757236:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea382040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659484672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.757272:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea382040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659484672:12345-0@lo:400:kworker.0 Request processed in 36us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349882.757278:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1783349882.757324:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659485440 00000100:00100000:3.0:1783349882.757328:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659485440 00000100:00100000:3.0:1783349882.757360:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659485952 00000100:00100000:3.0:1783349882.757363:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659485952 00000100:00100000:3.0:1783349882.757382:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1783349882.757388:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659485440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.757435:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659485440:12345-0@lo:400:kworker.0 Request processed in 47us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349882.757443:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1783349882.757456:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783349882.757462:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659485952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.757489:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659485952:12345-0@lo:400:kworker.0 Request processed in 28us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349882.757495:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00080000:2.0:1783349882.757938:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243723480 x1869977659485952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349882.757953:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659485952:0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.758020:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659484928:0@lo:400:kworker.0 00010000:00080000:2.0:1783349882.758030:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f538a80 x1869977659485440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349882.758039:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659485440:0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.758052:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783349882.758070:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659484800:0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.758101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349882.758128:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659484800 00000100:00100000:2.0:1783349882.758132:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659484800 00000100:00100000:2.0:1783349882.758227:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1783349882.758234:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659484800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.758271:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659484800:12345-0@lo:400:kworker.0 Request processed in 38us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349882.758278:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783349882.758406:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659484672:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.758413:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659485184:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.758440:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.758459:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659485696:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.758481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.758496:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659486208:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.758517:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.758537:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783349882.758544:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659485056:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.758565:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.758583:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659485568:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.758605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.758620:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659486080:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.758638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.758662:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659485056 00000100:00100000:3.0:1783349882.758666:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659485056 00000100:00100000:3.0:1783349882.758899:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783349882.758909:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659485056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.758950:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659485056:12345-0@lo:400:kworker.0 Request processed in 43us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349882.758956:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783349882.758990:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659485056:0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.759058:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659485696 00000100:00100000:2.0:1783349882.759062:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659485696 00000100:00080000:0.0:1783349882.759078:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349882.759083:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783349882.759084:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659486208 00000100:00100000:2.0:1783349882.759086:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659486208 00000100:00100000:0.0:1783349882.759092:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659485568 00000100:00100000:0.0:1783349882.759095:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659485568 00000100:00100000:2.0:1783349882.759101:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659486080 00000100:00100000:2.0:1783349882.759103:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659486080 00000100:00100000:0.0:1783349882.759113:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783349882.759124:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659485696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349882.759206:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659485696:12345-0@lo:400:kworker.0 Request processed in 86us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349882.762205:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659485184 00000100:00100000:3.0:1783349882.762221:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659485184 00000100:00100000:3.0:1783349882.762282:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783349882.762293:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659485184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.762375:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659485184:12345-0@lo:400:kworker.0 Request processed in 85us (3934us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349882.762383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783349882.762448:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659484800:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.762461:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659485312:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.762496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.762525:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659485824:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.762548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.762585:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659485312 00000100:00100000:3.0:1783349882.762589:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659485312 00000100:00100000:3.0:1783349882.762616:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659485824 00000100:00100000:3.0:1783349882.762619:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659485824 00000100:00100000:3.0:1783349882.762643:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783349882.762648:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659485312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.762683:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659485312:12345-0@lo:400:kworker.0 Request processed in 35us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349882.762721:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783349882.763052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783349882.763060:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659485824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.763094:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659485824:12345-0@lo:400:kworker.0 Request processed in 36us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349882.763099:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783349882.763226:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659485312:0@lo:400:kworker.0 00000100:00100000:3.0:1783349882.763241:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659485824:0@lo:400:kworker.0 00000100:00080000:3.0:1783349882.763325:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783349882.763329:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783349882.763332:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349882.763336:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349882.763345:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659486336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349882.763394:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783349882.763409:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36df49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659486208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.763446:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36df49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659486208:12345-0@lo:400:kworker.0 Request processed in 44us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349882.763453:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783349882.763468:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783349882.763474:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659485568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.763504:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659485568:12345-0@lo:400:kworker.0 Request processed in 31us (4899us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349882.763510:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783349882.763522:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783349882.763529:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659486080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349882.763570:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659486080:12345-0@lo:400:kworker.0 Request processed in 41us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349882.763576:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783349882.763642:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659486592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349882.763669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349882.763719:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659486592 00000100:00100000:2.0:1783349882.763723:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659486592 00000100:00100000:2.0:1783349882.763760:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783349882.763767:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659486592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783349882.763787:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349882.763876:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783349882.763970:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.764002:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659486464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349882.764033:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349882.764069:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659486464 00000100:00100000:3.0:1783349882.764073:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659486464 00000100:00100000:3.0:1783349882.764100:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783349882.764106:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659486464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783349882.764131:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00010000:00080000:0.0:1783349882.764131:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243723800 x1869977659485568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349882.764162:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659485568:0@lo:400:kworker.0 00000100:00100000:0.0:1783349882.769511:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659486080:0@lo:400:kworker.0 00000100:00100000:1.0:1783349882.769945:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659486336 00000100:00100000:1.0:1783349882.769954:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659486336 00000100:00100000:1.0:1783349882.770003:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783349882.770011:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659486336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349882.770039:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349882.772338:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659486464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8222us (8296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349882.772354:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783349882.772436:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659486464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349882.773424:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659486592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9652us (9749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349882.773436:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783349882.773554:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659486592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349882.774919:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659485184:0@lo:400:kworker.0 00010000:00080000:0.0:1783349882.774940:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243722300 x1869977659485696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349882.774952:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659485696:0@lo:400:kworker.0 00000100:00100000:0.0:1783349882.774963:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1783349882.774967:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea2438bb480, transno 4294967301 00000100:00100000:0.0:1783349882.775044:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659486208:0@lo:400:kworker.0 00000100:00100000:1.0:1783349882.775448:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659486336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5433us (11475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349882.775458:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783349882.775504:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659486336:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1783349883.333393:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783349883.333978:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783349883.524418:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349884.292543:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349884.292567:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659486720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349884.292652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349884.292823:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659486720 00000100:00100000:2.0:1783349884.292832:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659486720 00000100:00100000:2.0:1783349884.292912:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783349884.292925:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659486720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349884.292955:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349884.293001:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659486720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349884.293009:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1783349884.293048:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f53aa00 x1869977659486720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349884.293079:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659486720:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783349884.293564:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349884.293698:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349884.293849:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659486848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783349884.293881:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349884.294183:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659486848 00000100:00100000:2.0:1783349884.294201:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659486848 00000100:00100000:2.0:1783349884.294311:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783349884.294320:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659486848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783349884.294339:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349884.294386:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659486848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349884.294393:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1783349884.294525:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783349884.294644:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cce9880 x1869977659486848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349884.294656:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659486848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783349884.501699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349884.501799:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642626560 00000100:00100000:0.0:1783349884.501809:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642626560 00000100:00100000:0.0:1783349884.501867:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 365 00000100:00100000:0.0:1783349884.501877:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642626560:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349884.501963:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642626560:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349884.501970:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 365 00000100:00100000:1.0:1783349884.505014:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349884.505054:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349884.505083:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349884.505115:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349884.505337:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642626688 00000100:00100000:0.0:1783349884.505347:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642626688 00000100:00100000:0.0:1783349884.505403:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642627200 00000100:00100000:0.0:1783349884.505406:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642627200 00000100:00100000:0.0:1783349884.505422:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642626816 00000100:00100000:0.0:1783349884.505425:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642626816 00000100:00100000:0.0:1783349884.505443:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 210 00000100:00100000:0.0:1783349884.505452:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642626688:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349884.505525:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642626688:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 74us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349884.505532:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 210 00000100:00100000:0.0:1783349884.505550:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 211 00000100:00100000:0.0:1783349884.505557:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642627200:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349884.505583:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642627200:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349884.505602:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 211 00000100:00100000:0.0:1783349884.505617:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 212 00000100:00100000:0.0:1783349884.505623:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642626816:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349884.505650:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642626816:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349884.505669:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 212 00000100:00080000:0.0:1783349884.505712:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349884.505716:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349884.507922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349884.508184:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642626944 00000100:00100000:2.0:1783349884.508193:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642626944 00000100:00100000:2.0:1783349884.508274:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:2.0:1783349884.508287:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642626944:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349884.508358:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642626944:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 75us (3303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349884.508366:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:3.0:1783349884.509045:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642627072 00000100:00100000:3.0:1783349884.509052:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642627072 00000100:00100000:3.0:1783349884.509103:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 213 00000100:00100000:3.0:1783349884.509112:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642627072:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349884.509194:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642627072:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 83us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349884.509201:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 213 00000100:00080000:1.0:1783349884.511588:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349884.511599:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783349884.551761:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349885.572349:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349886.342411:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349886.342480:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659486976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783349886.342554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349886.342634:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659486976 00000100:00100000:0.0:1783349886.342658:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659486976 00000100:00100000:0.0:1783349886.342722:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783349886.342731:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659486976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783349886.342784:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783349886.342864:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659486976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349886.342872:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783349886.342946:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659486976:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783349886.601716:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349887.620669:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349887.878165:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659487232:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.878246:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.878323:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659487744:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.878346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.878369:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659488256:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.878388:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.878410:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1783349887.878415:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659487104:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.878441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.878477:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659487616:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.878502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.878520:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659488128:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.878541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349887.878541:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659487360:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.878564:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659488640:0@lo:400:kworker.0 00000100:00100000:1.0:1783349887.878586:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.878596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349887.878619:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659487872:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.878631:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659487488:0@lo:400:kworker.0 00000100:00100000:1.0:1783349887.878658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349887.878747:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659488128 00000100:00100000:0.0:1783349887.878754:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659488128 00000100:00100000:0.0:1783349887.878799:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659488640 00000100:00100000:0.0:1783349887.878802:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659488640 00000100:00100000:0.0:1783349887.878822:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783349887.878831:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659488128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.878930:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783349887.878939:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659488640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349887.883744:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349887.883779:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659488768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349887.889864:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659488128:12345-0@lo:400:kworker.0 Request processed in 11024us (11312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.889895:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1783349887.889940:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349887.889946:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349887.889963:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659487232 00000100:00100000:0.0:1783349887.889971:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659487232 00000100:00100000:0.0:1783349887.890017:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659487744 00000100:00100000:0.0:1783349887.890020:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659487744 00000100:00100000:0.0:1783349887.890041:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659488256 00000100:00100000:0.0:1783349887.890045:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659488256 00000100:00100000:0.0:1783349887.890058:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659487872 00000100:00100000:0.0:1783349887.890061:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659487872 00000100:00100000:3.0:1783349887.890073:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659487104 00000100:00100000:3.0:1783349887.890079:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659487104 00000100:00100000:0.0:1783349887.890084:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783349887.890093:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659487232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.890120:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1783349887.890129:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659487104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349887.890168:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659487232:12345-0@lo:400:kworker.0 Request processed in 76us (11922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.890176:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783349887.890192:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1783349887.890200:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659487104:12345-0@lo:400:kworker.0 Request processed in 71us (11755us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.890202:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659487744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.890214:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1783349887.890248:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659487744:12345-0@lo:400:kworker.0 Request processed in 48us (11899us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349887.890253:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659487616 00000100:00100000:0.0:1783349887.890257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1783349887.890259:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659487616 00000100:00100000:0.0:1783349887.890275:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1783349887.890283:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659488256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.890290:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659487360 00000100:00100000:3.0:1783349887.890294:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659487360 00000100:00100000:3.0:1783349887.890314:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783349887.890323:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659488256:12345-0@lo:400:kworker.0 Request processed in 39us (11932us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349887.890324:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659487616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349887.890337:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1783349887.890354:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783349887.890371:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659487616:12345-0@lo:400:kworker.0 Request processed in 49us (11866us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.890374:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659487872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.890383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783349887.890400:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783349887.890416:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659487360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349887.890420:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659487872:12345-0@lo:400:kworker.0 Request processed in 48us (11769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.890428:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:0.0:1783349887.890451:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349887.890455:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349887.890539:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349887.890568:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659488000:0@lo:400:kworker.0 00000100:00100000:0.0:1783349887.890597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349887.890622:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659488512:0@lo:400:kworker.0 00000100:00100000:0.0:1783349887.890645:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349887.890679:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659489024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349887.890703:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349887.890721:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349887.890727:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659488896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349887.890747:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659487360:12345-0@lo:400:kworker.0 Request processed in 46us (11875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.890747:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.890762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783349887.890775:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659489024 00000100:00100000:0.0:1783349887.890779:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659489024 00000100:00100000:0.0:1783349887.890807:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659488896 00000100:00100000:0.0:1783349887.890809:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659488896 00000100:00100000:0.0:1783349887.890826:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783349887.890831:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659489024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349887.890878:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349887.890910:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659489024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.890916:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783349887.890927:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783349887.890939:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659488896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783349887.890965:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349887.890995:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659488896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349887.890996:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659488000 00000100:00100000:2.0:1783349887.891003:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659488000 00000100:00100000:0.0:1783349887.891004:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1783349887.891023:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349887.891026:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659487104:0@lo:400:kworker.0 00000100:00080000:0.0:1783349887.891028:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349887.891035:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659488512 00000100:00100000:2.0:1783349887.891040:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659488512 00000100:00100000:3.0:1783349887.891051:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659487616:0@lo:400:kworker.0 00000100:00100000:2.0:1783349887.891061:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783349887.891062:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659488896:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1783349887.891071:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243080380 x1869977659488128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349887.891075:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659488000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349887.891082:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659489024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349887.891095:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659488128:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.891118:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659487232:0@lo:400:kworker.0 00000100:00100000:0.0:1783349887.891119:0:9981:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783349887.891130:0:9981:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1783349887.891153:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659488000:12345-0@lo:400:kworker.0 Request processed in 64us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349887.891162:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783349887.891165:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659487744:0@lo:400:kworker.0 00000100:00100000:2.0:1783349887.891182:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783349887.891184:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659488256:0@lo:400:kworker.0 00000100:00100000:2.0:1783349887.891193:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659488512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.891230:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659487488 00000100:00100000:3.0:1783349887.891235:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659487488 00000100:00100000:2.0:1783349887.891241:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659488512:12345-0@lo:400:kworker.0 Request processed in 50us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349887.891249:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783349887.891269:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1783349887.891277:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659487488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349887.891297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783349887.891301:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243081500 x1869977659488000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349887.891313:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659488000:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.891327:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659487488:12345-0@lo:400:kworker.0 Request processed in 50us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.891329:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659488512:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.891342:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783349887.891345:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659488768 00000100:00100000:2.0:1783349887.891350:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659488768 00000100:00100000:0.0:1783349887.891360:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659487488:0@lo:400:kworker.0 00000100:00100000:2.0:1783349887.891387:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783349887.891396:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659488640:12345-0@lo:400:kworker.0 Request processed in 12457us (12799us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349887.891397:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659488768:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349887.891411:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000004:00000024:2.0:1783349887.891434:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783349887.891444:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659488640:0@lo:400:kworker.0 00000100:00100000:2.0:1783349887.891474:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659488768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349887.891481:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783349887.892167:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659488768:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1783349887.893080:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243082680 x1869977659487872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349887.893094:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659487872:0@lo:400:kworker.0 00000100:00100000:1.0:1783349887.893105:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659488384:0@lo:400:kworker.0 00000100:00100000:1.0:1783349887.893291:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349887.893342:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659487360:0@lo:400:kworker.0 00000100:00100000:0.0:1783349887.898346:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659488384 00000100:00100000:0.0:1783349887.898358:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659488384 00000100:00100000:0.0:1783349887.898434:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783349887.898442:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659488384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349887.898522:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659488384:12345-0@lo:400:kworker.0 Request processed in 81us (5232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.898528:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:1.0:1783349887.901893:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783349887.901956:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243083800 x1869977659488384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349887.901973:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659488384:0@lo:400:kworker.0 00010000:00010000:3.0:1783349888.647289:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349889.412435:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349889.412460:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659489152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349889.412528:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349889.412584:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659489152 00000100:00100000:2.0:1783349889.412592:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659489152 00000100:00100000:2.0:1783349889.412656:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783349889.412665:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659489152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349889.412741:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783349889.412768:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349889.412798:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659489152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349889.412805:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1783349889.412885:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f53bb80 x1869977659489152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349889.413023:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659489152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349889.413200:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349889.413210:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659489280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349889.413240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349889.413293:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659489280 00000100:00100000:0.0:1783349889.413298:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659489280 00000100:00080000:2.0:1783349889.413348:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349889.413351:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783349889.413358:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659489280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783349889.413371:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349889.413414:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659489280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349889.413420:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1783349889.413582:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243044380 x1869977659489280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349889.413596:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659489280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349889.624725:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349889.624766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349889.624797:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349889.624885:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642627584 00000100:00100000:1.0:1783349889.624896:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642627584 00000100:00100000:1.0:1783349889.624966:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642627456 00000100:00100000:1.0:1783349889.624970:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642627456 00000100:00100000:1.0:1783349889.624992:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 220 00000100:00100000:1.0:1783349889.625002:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642627584:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349889.625080:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642627584:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 80us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349889.625088:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 220 00000100:00100000:1.0:1783349889.625104:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 221 00000100:00100000:1.0:1783349889.625112:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642627456:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349889.625174:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642627456:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349889.625180:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 221 00000100:00080000:2.0:1783349889.625353:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349889.625358:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783349889.626547:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642627328 00000100:00100000:3.0:1783349889.626559:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642627328 00000100:00100000:3.0:1783349889.626620:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 367 00000100:00100000:3.0:1783349889.626629:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642627328:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349889.626702:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642627328:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 73us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349889.626709:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 367 00000100:00100000:2.0:1783349889.638562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349889.640169:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349889.640255:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349889.640768:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642627712 00000100:00100000:3.0:1783349889.640770:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642627840 00000100:00100000:3.0:1783349889.640781:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642627840 00000100:00100000:0.0:1783349889.640781:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642627712 00000100:00100000:3.0:1783349889.640980:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642627968 00000100:00100000:3.0:1783349889.640984:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642627968 00000100:00100000:1.0:1783349889.641032:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 222 00000100:00100000:1.0:1783349889.641043:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642627840:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349889.641114:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642627840:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 73us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349889.641133:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 222 00000100:00080000:2.0:1783349889.650781:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783349889.650793:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349889.650796:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349889.658240:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:0.0:1783349889.658403:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2398:x1869977642627712:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:0.0:1783349889.658447:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2275 00000100:00080000:0.0:1783349889.658457:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8ea243219800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783349889.658712:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 223 00000100:00100000:3.0:1783349889.658720:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642627968:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349889.658791:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642627968:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 71us (18535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349889.658798:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 223 00000001:00000004:0.0:1783349889.659055:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1783349889.659243:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+2:2398:x1869977642627712:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 991us (20690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349889.659250:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00010000:00010000:2.0:1783349889.660511:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349889.668419:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349890.692989:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349891.460383:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659489408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349891.460454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349891.460670:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659489408 00000100:00100000:3.0:1783349891.460678:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659489408 00000100:00100000:3.0:1783349891.460734:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783349891.460744:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659489408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783349891.460778:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783349891.460831:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659489408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349891.460839:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783349891.460923:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659489408:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783349891.717098:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349892.740517:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349892.996468:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659489536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349892.996543:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349892.996682:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349892.996693:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659489664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349892.996752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349892.998834:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659489536 00000100:00100000:2.0:1783349892.998843:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659489536 00000100:00100000:2.0:1783349892.998906:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783349892.998917:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659489536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349892.998946:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349892.999007:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659489536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349892.999014:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783349892.999037:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659489664 00000100:00100000:2.0:1783349892.999041:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659489664 00000100:00100000:2.0:1783349892.999067:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783349892.999075:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659489664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783349892.999113:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349892.999171:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659489664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349892.999178:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1783349892.999205:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349892.999226:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659489920:0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999267:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349892.999298:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659490432:0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349892.999341:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659490944:0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349892.999387:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783349892.999394:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659490048:0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349892.999434:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659490560:0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999451:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349892.999600:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659491072:0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999635:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349892.999666:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659490432 00000100:00100000:2.0:1783349892.999670:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659490432 00000100:00100000:2.0:1783349892.999699:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659490944 00000100:00100000:2.0:1783349892.999702:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659490944 00000100:00100000:2.0:1783349892.999713:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659490048 00000100:00100000:2.0:1783349892.999716:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659490048 00000100:00100000:2.0:1783349892.999726:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659490560 00000100:00100000:2.0:1783349892.999728:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659490560 00000100:00100000:2.0:1783349892.999738:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659491072 00000100:00100000:2.0:1783349892.999740:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659491072 00000100:00100000:2.0:1783349892.999753:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783349892.999760:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659490432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999798:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659490432:12345-0@lo:400:kworker.0 Request processed in 38us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349892.999812:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783349892.999826:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783349892.999832:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659490944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999861:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659490944:12345-0@lo:400:kworker.0 Request processed in 30us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349892.999867:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783349892.999878:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1783349892.999884:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659490048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999908:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659490048:12345-0@lo:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349892.999914:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1783349892.999925:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1783349892.999931:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659490560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999954:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659490560:12345-0@lo:400:kworker.0 Request processed in 24us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349892.999959:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1783349892.999968:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1783349892.999973:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659491072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349892.999996:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659491072:12345-0@lo:400:kworker.0 Request processed in 23us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349893.000002:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:2.0:1783349893.000025:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783349893.000028:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349893.000062:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659489536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349893.000105:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659490048:0@lo:400:kworker.0 00010000:00080000:2.0:1783349893.000119:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243203800 x1869977659490560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349893.000129:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659490560:0@lo:400:kworker.0 00010000:00080000:2.0:1783349893.000162:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243202d80 x1869977659491072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349893.000171:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659491072:0@lo:400:kworker.0 00000100:00100000:2.0:1783349893.000181:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659490432:0@lo:400:kworker.0 00000100:00100000:2.0:1783349893.000190:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659490944:0@lo:400:kworker.0 00000100:00100000:2.0:1783349893.000236:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659489920 00000100:00100000:2.0:1783349893.000240:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659489920 00000100:00100000:2.0:1783349893.000268:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1783349893.000274:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34545ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659489920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349893.000308:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34545ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3648:x1869977659489920:12345-0@lo:400:kworker.0 Request processed in 34us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349893.000315:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1783349893.000352:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659489920:0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.000864:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659490176:0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.000898:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349893.000931:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659490688:0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.000954:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349893.000972:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659491200:0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.000993:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349893.001010:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783349893.001015:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659489792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349893.001037:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349893.001051:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659490304:0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.001071:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349893.001099:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659490816:0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.001121:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349893.001175:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659490688 00000100:00100000:3.0:1783349893.001180:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659490688 00000100:00100000:3.0:1783349893.001221:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659491200 00000100:00100000:3.0:1783349893.001224:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659491200 00000100:00100000:3.0:1783349893.001241:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659490816 00000100:00100000:3.0:1783349893.001243:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659490816 00000100:00100000:3.0:1783349893.001258:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783349893.001264:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659490688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.001304:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659490688:12345-0@lo:400:kworker.0 Request processed in 39us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349893.001310:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783349893.001324:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783349893.001330:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659491200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.001358:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659491200:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349893.001364:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783349893.001375:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783349893.001380:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659490816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.001406:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659490816:12345-0@lo:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349893.001411:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1783349893.001443:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243201500 x1869977659490816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349893.001639:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659490816:0@lo:400:kworker.0 00010000:00080000:3.0:1783349893.001655:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243202a00 x1869977659490688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349893.001665:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659490688:0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.001676:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659491200:0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.001705:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659490304 00000100:00100000:3.0:1783349893.001709:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659490304 00000100:00100000:3.0:1783349893.001738:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783349893.001744:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659490304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349893.001781:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659490304:12345-0@lo:400:kworker.0 Request processed in 37us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349893.001787:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783349893.001818:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659490304:0@lo:400:kworker.0 00000100:00100000:0.0:1783349893.002036:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659490176 00000100:00100000:0.0:1783349893.002041:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659490176 00000100:00100000:0.0:1783349893.002067:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783349893.002074:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659490176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349893.002128:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659490176:12345-0@lo:400:kworker.0 Request processed in 54us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349893.002159:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783349893.002182:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659489792 00000100:00100000:0.0:1783349893.002185:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659489792 00000100:00100000:0.0:1783349893.002208:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783349893.002214:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659489792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783349893.002229:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349893.002264:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659489792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349893.002270:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783349893.002302:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659489792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349893.002313:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659490176:0@lo:400:kworker.0 00000100:00100000:1.0:1783349893.002598:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659489664:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1783349893.003263:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349893.003268:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1783349893.574523:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783349893.574912:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783349893.765089:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349894.534624:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659491328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349894.534741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349894.534882:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349894.534911:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659491456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349894.534943:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349894.534996:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659491328 00000100:00100000:2.0:1783349894.535003:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659491328 00000100:00100000:2.0:1783349894.535044:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659491456 00000100:00100000:2.0:1783349894.535055:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659491456 00000100:00100000:2.0:1783349894.535071:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783349894.535078:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659491328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783349894.535105:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349894.535309:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659491328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 229us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349894.535318:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783349894.535344:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783349894.535351:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659491456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349894.535362:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349894.535391:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659491456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349894.535398:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1783349894.535435:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243765500 x1869977659491456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349894.535452:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659491456:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1783349894.535876:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243083480 x1869977659491328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349894.535890:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659491328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783349894.744102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349894.744187:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349894.744207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349894.744243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349894.744252:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642628096 00000100:00100000:0.0:1783349894.744263:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642628096 00000100:00100000:1.0:1783349894.744275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349894.744303:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642628352 00000100:00100000:1.0:1783349894.744308:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642628352 00000100:00100000:0.0:1783349894.744321:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 369 00000100:00100000:0.0:1783349894.744333:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2401:x1869977642628096:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349894.744354:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642628608 00000100:00100000:1.0:1783349894.744358:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642628608 00000100:00100000:1.0:1783349894.744378:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642628224 00000100:00100000:1.0:1783349894.744381:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642628224 00000100:00100000:3.0:1783349894.744393:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642628480 00000100:00100000:3.0:1783349894.744399:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642628480 00000100:00100000:0.0:1783349894.744403:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2401:x1869977642628096:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 73us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349894.744406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 230 00000100:00100000:0.0:1783349894.744418:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 369 00000100:00100000:1.0:1783349894.744421:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642628352:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349894.744429:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 231 00000100:00100000:3.0:1783349894.744438:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642628608:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349894.744464:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642628352:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349894.744473:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 230 00000100:00100000:3.0:1783349894.744486:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642628608:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 37us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349894.744495:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 232 00000100:00100000:1.0:1783349894.744565:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642628224:12345-192.168.203.50@tcp:400:kworker.0 00000100:00080000:0.0:1783349894.744606:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349894.744612:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642628224:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 109us (368us total) trans 0 rc 0/0 00000100:00080000:0.0:1783349894.744615:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783349894.744638:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 231 00000100:00100000:3.0:1783349894.744654:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 233 00000100:00100000:3.0:1783349894.744674:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642628480:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349894.744704:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642628480:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349894.744711:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 233 00000100:00100000:1.0:1783349894.757549:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 232 00010000:00010000:3.0:1783349894.789408:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783349895.046160:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:1.0:1783349895.046169:0:9511:0:(genops.c:906:class_export_put()) final put ffff8ea24321b800/689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:0.0:1783349895.046827:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24321b800/689af055-7605-419d-81ba-26cff8cb556b for lustre-OST0001 00000020:00000080:0.0:1783349895.050635:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea243219800 for lustre-OST0001 00000001:02000400:1.0:1783349895.706404:0:14055:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:58:13 (1783349893) 00010000:00010000:1.0:1783349895.812665:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349896.580688:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659491584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349896.580763:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349896.581324:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659491584 00000100:00100000:2.0:1783349896.581334:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659491584 00000100:00100000:2.0:1783349896.581386:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783349896.581399:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659491584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783349896.581434:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783349896.581696:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659491584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 297us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349896.581705:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783349896.581936:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659491584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783349896.836838:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349897.015121:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349897.015319:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642628736 00000100:00100000:3.0:1783349897.015329:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642628736 00000100:00100000:3.0:1783349897.015405:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:3.0:1783349897.015415:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:11053:x1869977642628736:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349897.015434:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349897.015500:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece71 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349897.015557:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e235c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349897.015571:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e235c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349897.015592:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e235c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349897.015637:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783349897.015641:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349897.015677:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e235c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349897.015701:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece71 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349897.015732:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e235c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece71 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349897.015741:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea34459e800) 00010000:00010000:3.0:1783349897.015744:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349897.015747:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc200, rc 0) 00000100:00100000:3.0:1783349897.015808:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+6:11053:x1869977642628736:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 395us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349897.015816:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00080000:0.0:1783349897.015945:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349897.022898:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349897.022968:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642628864 00000100:00100000:2.0:1783349897.022978:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642628864 00000100:00100000:2.0:1783349897.023052:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:2.0:1783349897.023061:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+6:11054:x1869977642628864:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349897.023081:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349897.023101:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece78 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023187:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e236a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023200:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e236a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023211:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e236a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023225:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2371 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023231:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023237:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023294:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2378 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023301:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2378 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023308:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2378 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349897.023512:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783349897.023515:0:8582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349897.023535:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2378 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023545:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e236a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023552:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e236a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023558:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e236a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023564:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349897.023568:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e236a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023574:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e236a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023595:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea34459e800) 00010000:00010000:2.0:1783349897.023598:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349897.023603:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e236a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023609:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e236a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023624:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023639:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2371 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023645:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023650:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349897.023653:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023660:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2371 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023673:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ea2424c5800) 00010000:00010000:2.0:1783349897.023675:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349897.023678:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2371 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023683:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2371 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023713:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece78 expref: 8 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023726:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2378 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece78 expref: 7 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349897.023732:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ea2424c5200) 00010000:00010000:2.0:1783349897.023734:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349897.023743:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341525000, rc 0) 00000100:00100000:2.0:1783349897.023955:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+7:11054:x1869977642628864:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 894us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349897.023963:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:2.0:1783349897.029988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349897.030070:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642628992 00000100:00100000:1.0:1783349897.030080:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642628992 00000100:00100000:1.0:1783349897.030471:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:1.0:1783349897.030482:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:689af055-7605-419d-81ba-26cff8cb556b+7:11054:x1869977642628992:12345-192.168.203.50@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783349897.030570:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:689af055-7605-419d-81ba-26cff8cb556b+7:11054:x1869977642628992:12345-192.168.203.50@tcp:900:lhsmtool_posix.0 Request processed in 90us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349897.030577:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:1.0:1783349897.036250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349897.036352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642629248 00000100:00100000:0.0:1783349897.036363:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642629248 00000100:00100000:0.0:1783349897.036424:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:0.0:1783349897.036435:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+7:11054:x1869977642629248:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349897.036455:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349897.036473:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e237f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036545:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2386 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036559:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2386 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036651:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2386 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036710:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e238d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036718:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e238d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036726:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e238d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036836:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f400/0xd05e6ae1590e2394 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036859:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f400/0xd05e6ae1590e2394 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036866:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f400/0xd05e6ae1590e2394 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349897.036876:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783349897.036960:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2386 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036969:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2386 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036975:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2386 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036981:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ee00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349897.036986:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2386 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.036993:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2386 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.037195:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ea2424c5200) 00010000:00010000:0.0:1783349897.037200:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349897.037205:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2386 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.037212:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2386 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.037226:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e238d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.037239:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e238d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.037245:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e238d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.037250:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ec00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349897.037254:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e238d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.037261:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e238d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.037270:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ea349e98f00) 00010000:00010000:0.0:1783349897.037272:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349897.037275:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e238d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.037281:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e238d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.039546:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e237f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece7f expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.039599:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f400/0xd05e6ae1590e2394 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece7f expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.039609:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:0.0:1783349897.039612:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349897.039628:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f400, rc 0) 00000100:00100000:0.0:1783349897.039704:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+9:11054:x1869977642629248:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 3270us (3462us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783349897.039714:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:3.0:1783349897.044178:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349897.044434:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642629376 00000100:00100000:0.0:1783349897.044445:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642629376 00000100:00100000:0.0:1783349897.044503:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:0.0:1783349897.044513:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+9:11054:x1869977642629376:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783349897.044635:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+9:11054:x1869977642629376:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 123us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349897.044643:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:2.0:1783349897.053572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349897.061380:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642629504 00000100:00100000:3.0:1783349897.061396:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642629504 00000100:00100000:3.0:1783349897.061493:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:3.0:1783349897.061507:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:11054:x1869977642629504:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1783349897.064229:0:8582:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2680us 00000100:00080000:1.0:1783349897.065754:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349897.087759:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:11054:x1869977642629504:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 26244us (34195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349897.087772:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00000040:00080000:0.0:1783349897.669023:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783349897.671236:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783349897.864692:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349898.116549:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349898.116584:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659491840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349898.116653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349898.116701:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659491840 00000100:00100000:1.0:1783349898.116710:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659491840 00000100:00100000:2.0:1783349898.116712:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36dbb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659491712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349898.116737:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349898.116768:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783349898.116779:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659491840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349898.116811:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349898.116863:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659491840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349898.116871:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1783349898.116892:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349898.117607:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659491840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349898.119124:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349898.119163:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659491968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349898.119207:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659491712 00000100:00100000:3.0:1783349898.119215:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659491712 00000100:00100000:3.0:1783349898.119273:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783349898.119284:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659491712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783349898.119331:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783349898.119479:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659491712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 196us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.119487:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783349898.119566:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36dbb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659491712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349898.119707:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659492224:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.119739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349898.119770:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24442ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659492736:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.119791:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349898.119805:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24442ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659493248:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.119823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349898.119866:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783349898.119873:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659492352:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.119896:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349898.119917:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24442ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659492864:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.119937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349898.119952:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659493376:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.119969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349898.119991:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659492224 00000100:00100000:3.0:1783349898.119994:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659492224 00000100:00100000:3.0:1783349898.120020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659492736 00000100:00100000:3.0:1783349898.120023:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659492736 00000100:00100000:3.0:1783349898.120047:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659493248 00000100:00100000:3.0:1783349898.120050:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659493248 00000100:00100000:3.0:1783349898.120063:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783349898.120069:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659492224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.120107:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659492224:12345-0@lo:400:kworker.0 Request processed in 37us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.120113:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783349898.120125:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783349898.120157:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659492736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.120197:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659492736:12345-0@lo:400:kworker.0 Request processed in 60us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.120204:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783349898.120217:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783349898.120223:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659493248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349898.120234:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659492352 00000100:00100000:0.0:1783349898.120238:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659492352 00000100:00100000:3.0:1783349898.120248:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659493248:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.120253:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783349898.120263:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783349898.120268:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659492352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.120274:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659492864 00000100:00100000:3.0:1783349898.120277:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659492864 00000100:00100000:3.0:1783349898.120299:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659493376 00000100:00100000:0.0:1783349898.120301:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659492352:12345-0@lo:400:kworker.0 Request processed in 33us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.120302:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659493376 00000100:00100000:0.0:1783349898.120307:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783349898.120319:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783349898.120325:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659492864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.120354:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659492864:12345-0@lo:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.120359:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783349898.120369:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783349898.120374:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659493376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.120404:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659493376:12345-0@lo:400:kworker.0 Request processed in 30us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.120410:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783349898.120421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783349898.120438:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349898.120442:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783349898.120444:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783349898.120465:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659492480:0@lo:400:kworker.0 00000100:00100000:2.0:1783349898.120470:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659492096:0@lo:400:kworker.0 00000100:00100000:2.0:1783349898.120512:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349898.120517:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349898.120551:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659492992:0@lo:400:kworker.0 00000100:00100000:2.0:1783349898.120557:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24442d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659492608:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.120589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349898.120602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349898.120627:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24442ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659493120:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.120629:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659492992 00000100:00100000:3.0:1783349898.120634:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659492992 00000100:00100000:2.0:1783349898.120653:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349898.120668:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783349898.120676:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659492992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349898.120692:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659492096 00000100:00100000:2.0:1783349898.120698:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659492096 00000100:00100000:3.0:1783349898.120717:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659492992:12345-0@lo:400:kworker.0 Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.120723:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783349898.120738:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00080000:3.0:1783349898.120746:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349898.120747:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659492096:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783349898.120773:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24442d500 x1869977659492992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349898.120787:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659492992:0@lo:400:kworker.0 00000100:00100000:2.0:1783349898.120800:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659492096:12345-0@lo:400:kworker.0 Request processed in 54us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349898.120809:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1783349898.120813:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659492480 00000100:00100000:3.0:1783349898.120818:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659492480 00000100:00100000:0.0:1783349898.120822:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659491968 00000100:00100000:0.0:1783349898.120826:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659491968 00000100:00100000:3.0:1783349898.120845:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659492608 00000100:00100000:3.0:1783349898.120847:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659492608 00000100:00100000:2.0:1783349898.120854:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659493120 00000100:00100000:0.0:1783349898.120859:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783349898.120861:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659493120 00000100:00100000:0.0:1783349898.120868:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659491968:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349898.120870:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783349898.120878:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659492480:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1783349898.120889:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349898.120895:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783349898.120920:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659492480:12345-0@lo:400:kworker.0 Request processed in 40us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349898.120921:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659492608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349898.120927:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659491968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.120935:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783349898.120947:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783349898.120949:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783349898.120957:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659493120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349898.120969:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659492608:12345-0@lo:400:kworker.0 Request processed in 64us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349898.120977:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783349898.121000:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659493120:12345-0@lo:400:kworker.0 Request processed in 43us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349898.121011:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659492096:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.121014:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1783349898.121031:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24442d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659492608:0@lo:400:kworker.0 00000100:00080000:3.0:1783349898.121044:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349898.121047:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24442ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659493120:0@lo:400:kworker.0 00000100:00100000:2.0:1783349898.121070:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659491968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349898.121074:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659492480:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.121112:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659492352:0@lo:400:kworker.0 00010000:00080000:3.0:1783349898.121126:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24442ea00 x1869977659492864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349898.121154:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24442ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659492864:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.121167:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659493376:0@lo:400:kworker.0 00000100:00100000:3.0:1783349898.121179:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659492224:0@lo:400:kworker.0 00010000:00080000:3.0:1783349898.121191:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24442ce00 x1869977659492736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349898.121200:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24442ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659492736:0@lo:400:kworker.0 00010000:00080000:3.0:1783349898.121211:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24442ca80 x1869977659493248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349898.121221:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24442ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659493248:0@lo:400:kworker.0 00000100:00100000:2.0:1783349898.606237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349898.606313:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642629632 00000100:00100000:3.0:1783349898.606324:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642629632 00000100:00100000:3.0:1783349898.606385:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:3.0:1783349898.606395:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+9:11097:x1869977642629632:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349898.606415:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349898.606434:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e23a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece86 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606503:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e23a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606516:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e23a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606528:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e23a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606541:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215f800/0xd05e6ae1590e23b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606548:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215f800/0xd05e6ae1590e23b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606554:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215f800/0xd05e6ae1590e23b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606601:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e23a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606608:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e23a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606615:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e23a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606620:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea38215fe00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349898.606624:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e23a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606641:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e23a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606653:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea34459e800) 00010000:00010000:3.0:1783349898.606655:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349898.606660:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e23a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606666:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215fe00/0xd05e6ae1590e23a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606677:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215f800/0xd05e6ae1590e23b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606682:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215f800/0xd05e6ae1590e23b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606687:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215f800/0xd05e6ae1590e23b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606692:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea38215f800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349898.606695:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215f800/0xd05e6ae1590e23b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606700:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215f800/0xd05e6ae1590e23b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606706:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ea370dceb00) 00010000:00010000:3.0:1783349898.606708:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349898.606710:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215f800/0xd05e6ae1590e23b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606723:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea38215f800/0xd05e6ae1590e23b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606751:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e23a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece86 expref: 10 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606759:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea34459e800) 00010000:00010000:3.0:1783349898.606761:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349898.606765:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e23a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece86 expref: 10 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.606773:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cda00, rc 0) 00000100:00100000:3.0:1783349898.606883:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+9:11097:x1869977642629632:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 481us (739us total) trans 0 rc 301/301 00000100:00100000:3.0:1783349898.606891:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:0.0:1783349898.615254:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349898.616009:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642629888 00000100:00100000:1.0:1783349898.616019:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642629888 00000100:00100000:1.0:1783349898.616088:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:1.0:1783349898.616100:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+9:11097:x1869977642629888:12345-192.168.203.50@tcp:36:lfs.0 00010000:00010000:1.0:1783349898.616180:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349898.616207:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e235c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece71 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616223:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea34459e800) 00010000:00010000:1.0:1783349898.616234:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349898.616291:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e23b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616305:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e23b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616314:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e23b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616336:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616344:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616351:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616785:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616792:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616797:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349898.616815:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029be3b3e reply state 00000000a2bb136d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616826:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616833:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349898.616836:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349898.616839:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783349898.616844:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783349898.616851:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e23b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616857:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e23b7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616864:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e23b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616869:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ca00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349898.616874:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e23b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616881:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e23b7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616901:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea24310fd00) 00010000:00010000:1.0:1783349898.616904:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349898.616907:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e23b7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616923:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e23b7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349898.616939:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029be3b3e reply state 00000000a2bb136d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616949:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.616955:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ea24310fc00) 00010000:00010000:1.0:1783349898.616957:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349898.616960:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783349898.617052:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+10:11097:x1869977642629888:12345-192.168.203.50@tcp:36:lfs.0 Request processed in 953us (2051us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783349898.617061:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:0.0:1783349898.667179:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349898.670673:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642630016 00000100:00100000:3.0:1783349898.670691:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642630016 00000100:00100000:2.0:1783349898.670904:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:2.0:1783349898.670914:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+10:11105:x1869977642630016:12345-192.168.203.50@tcp:101:lctl.0 00010000:00010000:2.0:1783349898.670938:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349898.670961:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e23cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.671022:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e23d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.671035:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e23d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.671060:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e23d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349898.671102:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783349898.671107:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349898.671245:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e23d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.671271:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e23cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece8d expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.671293:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e23d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece8d expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.671303:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:2.0:1783349898.671306:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349898.671310:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea341525c00, rc 0) 00000100:00100000:2.0:1783349898.671378:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+11:11105:x1869977642630016:12345-192.168.203.50@tcp:101:lctl.0 Request processed in 465us (4208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349898.671386:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:1.0:1783349898.718899:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349898.721467:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642630144 00000100:00100000:2.0:1783349898.721481:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642630144 00000100:00100000:2.0:1783349898.721617:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:2.0:1783349898.721627:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+11:11110:x1869977642630144:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783349898.721647:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349898.721667:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e23da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.721750:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e23e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.721776:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e23e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.721786:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e23e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.721806:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e23e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.721813:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e23e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.721821:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e23e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.721899:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e23ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.721908:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e23ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.721914:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e23ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349898.721947:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783349898.721951:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349898.721985:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e23ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722007:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e23e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722014:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e23e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722020:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e23e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722026:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349898.722030:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e23e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722038:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e23e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722050:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:2.0:1783349898.722053:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349898.722057:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e23e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722063:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e23e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722079:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e23e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722085:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e23e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722091:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e23e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722102:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349898.722105:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e23e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722111:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e23e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722120:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ea24310fc00) 00010000:00010000:2.0:1783349898.722123:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349898.722126:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e23e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722132:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e23e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722206:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e23da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece94 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722219:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e23ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece94 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.722227:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:2.0:1783349898.722230:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783349898.722232:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f1000, rc 0) 00000100:00100000:2.0:1783349898.722299:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+12:11110:x1869977642630144:12345-192.168.203.50@tcp:101:bash.0 Request processed in 673us (3409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349898.723768:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:0.0:1783349898.728356:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349898.728492:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642630400 00000100:00100000:1.0:1783349898.728501:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642630400 00000100:00100000:1.0:1783349898.728557:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:1.0:1783349898.728576:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+12:11110:x1869977642630400:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1783349898.728596:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349898.728614:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e23f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dece9b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.728709:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e23fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.728723:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e23fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.728748:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e23fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.728789:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.728926:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.728934:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783349898.730002:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1783349898.730653:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.730668:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.730677:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.730714:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e23fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.730723:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e23fd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.730730:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e23fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.730736:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349898.730751:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e23fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.730760:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e23fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.730772:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349898.730776:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349898.730780:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e23fd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.730787:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e23fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349898.731398:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a84a4996 reply state 00000000509080a7 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.731411:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.731418:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310fd00) 00010000:00010000:1.0:1783349898.731421:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349898.731424:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783349898.731466:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e23f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece9b expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.731481:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece9b expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349898.731489:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea24310f200) 00010000:00010000:1.0:1783349898.731491:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349898.731503:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d200, rc 0) 00000100:00100000:1.0:1783349898.731770:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+15:11110:x1869977642630400:12345-192.168.203.50@tcp:101:bash.0 Request processed in 3202us (3420us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1783349898.731779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:1.0:1783349898.738008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349898.738162:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642630528 00000100:00100000:3.0:1783349898.738173:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642630528 00000100:00100000:3.0:1783349898.738213:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:3.0:1783349898.738221:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1869977642630528:12345-192.168.203.50@tcp:8:bash.0 00010000:00080000:3.0:1783349898.738251:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1783349898.738279:0:8431:0:(genops.c:1406:class_connect()) connect: client 689af055-7605-419d-81ba-26cff8cb556b, cookie 0xd05e6ae1590e2419 00002000:00100000:3.0:1783349898.738291:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 689af055-7605-419d-81ba-26cff8cb556b/ffff8ea2437df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783349898.738316:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783349898.738385:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783349898.738426:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ea2437de800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349898.738492:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2398:x1869977642630528:12345-192.168.203.50@tcp:8:bash.0 Request processed in 269us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.738500:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:2.0:1783349898.747913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349898.748072:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642630656 00000100:00100000:3.0:1783349898.748081:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642630656 00000100:00100000:3.0:1783349898.748191:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:3.0:1783349898.748202:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+6:0:x1869977642630656:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1783349898.748220:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349898.748242:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe5d5896/0xd05e6ae1590e2420 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decea2 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783349898.748314:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783349898.748335:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1783349898.748339:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349898.748349:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe5d5896/0xd05e6ae1590e2420 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea2 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.748368:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe5d5896/0xd05e6ae1590e2420 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea2 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.748381:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030200, rc 0) 00000100:00100000:3.0:1783349898.748514:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+7:0:x1869977642630656:12345-192.168.203.50@tcp:101:bash.0 Request processed in 312us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.748521:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00080000:0.0:1783349898.748593:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349898.752171:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349898.752247:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642630784 00000100:00100000:3.0:1783349898.752257:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642630784 00000100:00100000:3.0:1783349898.752333:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:3.0:1783349898.752343:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+7:11110:x1869977642630784:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1783349898.752361:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349898.752377:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decea9 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.752419:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe5d5896/0xd05e6ae1590e2420 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea2 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.752430:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349898.752433:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349898.752439:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.752490:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe5d5896/0xd05e6ae1590e2420 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea2 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.752503:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe5d5896/0xd05e6ae1590e2420 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea2 expref: 8 pid: 8432 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349898.752518:0:8433:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24442ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1869977659493504:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349898.752634:0:8433:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b180 going to sleep for 11 seconds 00000100:00100000:3.0:1783349898.756072:0:8433:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24442ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1869977659493504:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349898.756107:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349898.756181:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031e00, rc 0) 00000100:00100000:3.0:1783349898.756282:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+8:11110:x1869977642630784:12345-192.168.203.50@tcp:101:bash.0 Request processed in 3940us (4155us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349898.756291:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:1.0:1783349898.760325:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349898.760423:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642630912 00000100:00100000:0.0:1783349898.760434:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642630912 00010000:00010000:0.0:1783349898.760475:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe5d5896/0xd05e6ae1590e2420 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea2 expref: 8 pid: 8432 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349898.760520:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:0.0:1783349898.760531:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350948c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642630912:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349898.760545:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349898.760565:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe5d5896/0xd05e6ae1590e2420 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea2 expref: 8 pid: 8432 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349898.760594:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe5d5896/0xd05e6ae1590e2420 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea2 expref: 8 pid: 8432 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349898.760620:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe5d5896/0xd05e6ae1590e2420 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea2 expref: 8 pid: 8432 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349898.760639:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349898.760656:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349898.760665:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349898.760675:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349898.760713:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349898.760739:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6503:1869977659493632:192.168.203.50@tcp:105: 00000100:00100000:0.0:1783349898.760821:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24310d780 going to sleep for 11 seconds 00000100:00100000:1.0:1783349898.774917:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349898.775018:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642631168 00000100:00100000:2.0:1783349898.775039:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642631168 00000100:00100000:2.0:1783349898.775095:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:2.0:1783349898.775105:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+15:11110:x1869977642631168:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:2.0:1783349898.775421:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+16:11110:x1869977642631168:12345-192.168.203.50@tcp:35:bash.0 Request processed in 308us (503us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783349898.775430:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:0.0:1783349898.780278:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6503:1869977659493632:192.168.203.50@tcp:105: 00010000:00010000:0.0:1783349898.780307:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349898.780556:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350948c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+7:2399:x1869977642630912:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 20025us (20238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349898.780576:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00010000:00010000:1.0:1783349898.884345:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349898.909185:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349898.909335:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642631424 00000100:00100000:2.0:1783349898.909347:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642631424 00000100:00100000:2.0:1783349898.909429:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:2.0:1783349898.909440:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+16:11121:x1869977642631424:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349898.909466:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349898.909487:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e242e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5deceb0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349898.909644:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783349898.909788:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e242e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceb0 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.909804:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:2.0:1783349898.909808:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349898.909813:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e242e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceb0 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.909830:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f1200, rc 0) 00000100:00100000:2.0:1783349898.909897:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+17:11121:x1869977642631424:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 459us (768us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1783349898.909916:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:2.0:1783349898.917897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349898.921630:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642631680 00000100:00100000:3.0:1783349898.921644:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642631680 00000100:00100000:3.0:1783349898.921931:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1783349898.921943:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+17:11121:x1869977642631680:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1783349898.922222:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+18:11121:x1869977642631680:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 281us (4334us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783349898.922231:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:1.0:1783349899.020642:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349899.020886:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642631808 00000100:00100000:2.0:1783349899.021928:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642631808 00000100:00100000:2.0:1783349899.022055:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:2.0:1783349899.022065:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+18:11127:x1869977642631808:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349899.022087:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349899.022104:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e243c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5deceb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.022198:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e2443 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.022222:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e2443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.022235:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e2443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349899.022274:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783349899.022278:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349899.022296:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e2443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.022320:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e243c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceb7 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.022338:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e2443 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceb7 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.022363:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:2.0:1783349899.022366:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349899.022369:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f1800, rc 0) 00000100:00100000:2.0:1783349899.022434:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+19:11127:x1869977642631808:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 370us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349899.022442:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00080000:0.0:1783349899.028048:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349899.032291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.032383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642632064 00000100:00100000:3.0:1783349899.032393:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642632064 00000100:00100000:3.0:1783349899.032449:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:3.0:1783349899.032458:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+19:11127:x1869977642632064:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349899.032478:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349899.032502:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e244a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decebe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.032622:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2451 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.032636:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2451 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.032648:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2451 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349899.032675:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783349899.032770:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e244a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decebe expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.032789:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2451 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decebe expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.032798:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea24310f200) 00010000:00010000:3.0:1783349899.032801:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349899.032804:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031800, rc 0) 00000100:00100000:3.0:1783349899.032860:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+21:11127:x1869977642632064:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 403us (589us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1783349899.032867:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:1.0:1783349899.038966:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349899.039024:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.039107:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642632448 00000100:00100000:3.0:1783349899.039118:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642632448 00000100:00100000:3.0:1783349899.039208:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:3.0:1783349899.039218:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+21:11127:x1869977642632448:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349899.039242:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349899.039262:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e245f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decec5 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.039370:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2466 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.039384:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2466 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.039408:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2466 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349899.039422:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783349899.039521:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e245f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decec5 expref: 24 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.039541:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2466 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decec5 expref: 23 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.039702:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea24310f200) 00010000:00010000:3.0:1783349899.039705:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783349899.039709:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031200, rc 0) 00000100:00100000:3.0:1783349899.039810:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+23:11127:x1869977642632448:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 593us (784us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1783349899.039818:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:0.0:1783349899.040230:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642632192 00000100:00100000:0.0:1783349899.040237:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642632192 00000100:00100000:0.0:1783349899.040280:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1783349899.040289:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+23:2402:x1869977642632192:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349899.040301:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349899.040317:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2451 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decebe expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.040346:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea24310f200) 00010000:00010000:0.0:1783349899.040350:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349899.040374:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+22:2402:x1869977642632192:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 87us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349899.040381:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:1.0:1783349899.048912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349899.048987:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642632576 00000100:00100000:0.0:1783349899.048997:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642632576 00000100:00100000:0.0:1783349899.049054:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:0.0:1783349899.049064:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642632576:12345-192.168.203.50@tcp:1:lfs.0 00010000:00010000:0.0:1783349899.049108:0:9981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.049129:0:9981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.049167:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349899.049171:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349899.049175:0:9981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.049209:0:9981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.049222:0:9981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 7 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349899.049255:0:9981:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9981:1869977659493760:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349899.049346:0:9981:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24310d540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349899.052540:0:9981:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9981:1869977659493760:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349899.052586:0:9981:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349899.053761:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349899.053866:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642632704 00000100:00100000:2.0:1783349899.053874:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642632704 00002000:00100000:2.0:1783349899.053922:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8ea350a3bb80 x1869977642632704/t0(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:650/0 lens 504/0 e 0 to 0 dl 1783349910 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783349899.053942:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea350a3bb80 with x1869977642632704 ext(0->12) 00010000:00010000:2.0:1783349899.053952:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 8 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.053966:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 8 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349899.053973:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ea350a3bb80 00000100:00100000:2.0:1783349899.054005:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:2.0:1783349899.054013:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:689af055-7605-419d-81ba-26cff8cb556b+8:2400:x1869977642632704:12345-192.168.203.50@tcp:4:lfs.0 00000001:00100000:0.0:1783349899.056102:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000100:00100000:2.0:1783349899.057728:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:689af055-7605-419d-81ba-26cff8cb556b+9:2400:x1869977642632704:12345-192.168.203.50@tcp:4:lfs.0 Request processed in 3708us (3965us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783349899.057741:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00002000:00100000:2.0:1783349899.057752:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8ea350a3bb80 x1869977642632704/t4294967300(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:650/0 lens 504/448 e 0 to 0 dl 1783349910 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783349899.057772:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea350a3bb80 with x1869977642632704 ext(0->12) 00010000:00010000:2.0:1783349899.057782:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.057815:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349899.057823:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ea350a3bb80 00000100:00100000:2.0:1783349899.066470:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349899.066596:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642632832 00000100:00100000:0.0:1783349899.066606:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642632832 00010000:00010000:0.0:1783349899.066644:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349899.066687:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:0.0:1783349899.066698:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642632832:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349899.066714:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783349899.066732:0:7459:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783349899.066735:0:7459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1783349897 00002000:00010000:0.0:1783349899.066736:0:7459:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1783349898 00002000:00010000:0.0:1783349899.066738:0:7459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1783349897 00002000:00010000:0.0:1783349899.066740:0:7459:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783349899.066745:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.066758:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.066793:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e2427 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decea9 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.066822:0:7459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349899.066827:0:7459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349899.066832:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.066842:0:7459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.066872:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349899.066951:0:9981:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.066961:0:9981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.066980:0:9981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.066988:0:9981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.067004:0:9981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.067011:0:9981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ee00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349899.067015:0:9981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.067025:0:9981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.067036:0:9981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.067043:0:9981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e2474 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349899.070500:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642632832:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 3784us (4031us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349899.070514:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:3.0:1783349899.071964:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642632576:12345-192.168.203.50@tcp:1:lfs.0 Request processed in 22893us (23052us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349899.071976:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:1.0:1783349899.078640:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349899.078845:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642633088 00000100:00100000:2.0:1783349899.078857:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642633088 00000100:00100000:2.0:1783349899.078917:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:2.0:1783349899.078928:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+22:11127:x1869977642633088:12345-192.168.203.50@tcp:35:lfs.0 00000004:00010000:2.0:1783349899.078988:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2466 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decec5 expref: 22 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349899.079265:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1783349899.079315:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1783349899.079591:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1783349899.079628:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.079643:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece9b expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.079651:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.079698:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece9b expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.079713:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece9b expref: 26 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349899.079727:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1869977659493888:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349899.079805:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349899.086779:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.086912:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1869977659493888:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349899.086938:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349899.087087:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642633216 00000100:00100000:0.0:1783349899.087094:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642633216 00010000:00010000:0.0:1783349899.087129:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece9b expref: 27 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349899.092311:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:0.0:1783349899.092334:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+27:2400:x1869977642633216:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349899.092356:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349899.092365:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece9b expref: 27 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.092400:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece9b expref: 27 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.092424:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e240b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece9b expref: 27 pid: 6517 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.092440:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea24310f200) 00010000:00010000:0.0:1783349899.092445:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.092454:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.092461:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.092494:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349899.092547:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+26:2400:x1869977642633216:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 227us (5777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349899.092555:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 54 00010000:00010000:3.0:1783349899.092655:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.092674:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783349899.092779:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1783349899.092952:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1783349899.093053:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24442ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659494016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783349899.093107:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349899.094590:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659494016 00000100:00100000:0.0:1783349899.094601:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659494016 00000100:00100000:0.0:1783349899.094653:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783349899.094660:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1869977659494016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783349899.099846:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1869977659494016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 5177us (6729us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349899.099861:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783349899.109760:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea34626b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783349899.109820:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24442ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659494016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783349899.110025:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1783349899.110099:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659494144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783349899.110195:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349899.110219:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349899.114091:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659494144 00000100:00100000:3.0:1783349899.114107:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659494144 00000100:00100000:3.0:1783349899.114178:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783349899.114188:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1869977659494144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783349899.114500:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1869977659494144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 313us (4305us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783349899.114508:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783349899.114607:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243147480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659494144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783349899.114668:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1783349899.114716:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.114727:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.114734:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.114740:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3429f1200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349899.114745:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.114753:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.114769:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea24310f200) 00010000:00010000:0.0:1783349899.114772:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783349899.114775:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.114780:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e247b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783349899.114884:0:6521:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783349899.114955:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783349899.114965:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339909828162ns, next at 340909826618ns, rc = 0 00000001:00080000:0.0:1783349899.114971:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1783349899.114991:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea24310f200) 00010000:00010000:0.0:1783349899.115005:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783349899.115012:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2466 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decec5 expref: 30 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349899.115105:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+29:11127:x1869977642633088:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 36180us (36474us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1783349899.115113:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000020:00080000:0.0:1783349899.115116:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783349899.124189:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.124297:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642633344 00000100:00100000:3.0:1783349899.124306:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642633344 00000100:00100000:3.0:1783349899.124365:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:3.0:1783349899.124375:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+29:11127:x1869977642633344:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349899.124398:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349899.124419:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2482 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5dececc expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.124473:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2482 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dececc expref: 30 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.124487:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2482 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dececc expref: 30 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.124523:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349899.124526:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349899.124529:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030a00, rc 0) 00000100:00100000:3.0:1783349899.124588:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+30:11127:x1869977642633344:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 214us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349899.124595:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:1.0:1783349899.138078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.138416:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642633600 00000100:00100000:3.0:1783349899.138427:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642633600 00000100:00100000:2.0:1783349899.138598:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:2.0:1783349899.138610:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fcb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+30:11127:x1869977642633600:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349899.138870:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fcb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+31:11127:x1869977642633600:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 261us (801us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1783349899.138877:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:1.0:1783349899.209877:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.209986:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642633856 00000100:00100000:3.0:1783349899.209996:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642633856 00000100:00100000:3.0:1783349899.210055:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:3.0:1783349899.210064:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+31:11137:x1869977642633856:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349899.210088:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349899.210105:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5deced3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349899.210238:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783349899.210328:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2489 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deced3 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.210343:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:3.0:1783349899.210347:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783349899.210351:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deced3 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.210366:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030800, rc 0) 00000100:00100000:3.0:1783349899.210437:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+32:11137:x1869977642633856:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 373us (568us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1783349899.210444:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:1.0:1783349899.213801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.213901:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642633984 00000100:00100000:3.0:1783349899.213911:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642633984 00000100:00100000:3.0:1783349899.214014:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:3.0:1783349899.214025:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+32:11137:x1869977642633984:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:3.0:1783349899.214089:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2497 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214106:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2497 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214119:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2497 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214394:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e249e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214402:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e249e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214410:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e249e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214482:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214491:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214622:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349899.214683:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214696:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2497 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214702:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2497 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214710:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2497 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214715:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349899.214719:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2497 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214726:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2497 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214737:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:3.0:1783349899.214740:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349899.214744:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2497 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214750:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2497 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214762:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e249e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214769:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e249e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.214780:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e249e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215670:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349899.215679:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e249e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215688:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e249e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215700:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310fd00) 00010000:00010000:3.0:1783349899.215703:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349899.215706:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e249e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215713:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e249e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215726:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215732:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215738:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215743:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349899.215746:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215765:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215772:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349899.215774:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349899.215777:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.215783:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349899.217686:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+32:11137:x1869977642633984:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 3657us (3897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349899.217698:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:1.0:1783349899.226073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349899.226127:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642634240 00000100:00100000:0.0:1783349899.226157:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642634240 00000100:00100000:0.0:1783349899.226265:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1783349899.226276:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+32:11137:x1869977642634240:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:0.0:1783349899.226487:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+33:11137:x1869977642634240:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 213us (420us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1783349899.226505:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:1.0:1783349899.253467:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349899.253541:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642634496 00000100:00100000:0.0:1783349899.253552:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642634496 00000100:00100000:0.0:1783349899.253622:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:0.0:1783349899.253634:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+33:11140:x1869977642634496:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349899.253658:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349899.253678:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e24ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5deceda expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.253757:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e24b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.253773:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e24b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.254132:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e24b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.254959:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.254970:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.254978:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.256096:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.256111:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.256120:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349899.256130:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783349899.259107:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e24b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.259125:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e24b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.259133:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e24b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.259880:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ee00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349899.259902:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e24b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.259911:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e24b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.259938:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:0.0:1783349899.259942:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349899.259946:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e24b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.259953:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e24b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.259967:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.259973:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.259979:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.259984:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ec00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349899.259996:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.260002:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.260812:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310fd00) 00010000:00010000:0.0:1783349899.260815:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349899.260828:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.260835:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.260897:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e24ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceda expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.260913:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceda expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.260920:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:0.0:1783349899.260923:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349899.260926:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e400, rc 0) 00000100:00100000:0.0:1783349899.260983:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+35:11140:x1869977642634496:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 7351us (7524us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1783349899.260991:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:1.0:1783349899.275173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349899.275277:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642634624 00000100:00100000:2.0:1783349899.275286:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642634624 00000100:00100000:2.0:1783349899.275345:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:2.0:1783349899.275355:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+35:11140:x1869977642634624:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:2.0:1783349899.275455:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e24cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.275472:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e24cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.275484:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e24cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.275521:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e24cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.275527:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e24cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.275533:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e24cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.275539:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349899.275542:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e24cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.275560:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e24cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.275636:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349899.275639:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349899.275642:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e24cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.275646:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e24cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349899.275726:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+35:11140:x1869977642634624:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 373us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349899.275733:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:1.0:1783349899.279663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349899.280302:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642634880 00000100:00100000:2.0:1783349899.280322:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642634880 00000100:00100000:2.0:1783349899.280441:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1783349899.280451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+35:11140:x1869977642634880:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349899.280719:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+36:11140:x1869977642634880:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 269us (1064us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1783349899.280727:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:1.0:1783349899.459457:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.459653:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642635136 00000100:00100000:3.0:1783349899.459663:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642635136 00000100:00100000:3.0:1783349899.459730:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:3.0:1783349899.459748:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+36:11171:x1869977642635136:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:3.0:1783349899.459770:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349899.459800:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decee1 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.460103:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e24dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.460119:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e24dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.460131:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e24dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349899.460346:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783349899.460645:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e24d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee1 expref: 39 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.460667:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e24dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee1 expref: 38 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.460675:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349899.460678:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349899.460681:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030c00, rc 0) 00000100:00100000:3.0:1783349899.461320:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+38:11171:x1869977642635136:12345-192.168.203.50@tcp:101:cat.0 Request processed in 1578us (1881us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783349899.461329:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:1.0:1783349899.463070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.464154:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642635264 00000100:00100000:3.0:1783349899.464166:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642635264 00000100:00100000:3.0:1783349899.464241:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1783349899.464251:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+38:2401:x1869977642635264:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349899.464269:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349899.464292:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e24dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee1 expref: 38 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.464311:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349899.464316:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349899.464471:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+37:2401:x1869977642635264:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 221us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349899.464479:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:1.0:1783349899.464628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349899.464753:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642635520 00000100:00100000:0.0:1783349899.464757:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642635520 00000100:00100000:0.0:1783349899.464796:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:0.0:1783349899.464804:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+37:11171:x1869977642635520:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:0.0:1783349899.465026:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+38:11171:x1869977642635520:12345-192.168.203.50@tcp:35:cat.0 Request processed in 222us (398us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1783349899.465033:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:2.0:1783349899.503350:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349899.503407:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642635776 00000100:00100000:0.0:1783349899.503416:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642635776 00000100:00100000:0.0:1783349899.503507:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:0.0:1783349899.503515:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+38:11177:x1869977642635776:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:0.0:1783349899.503547:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349899.503550:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783349899.503586:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e2443 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceb7 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.503606:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:0.0:1783349899.503611:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349899.503623:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e24eb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decee8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.503715:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.503729:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceda expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.503737:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.503762:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceda expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.503771:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceda expref: 38 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349899.503780:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243722300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659494272:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349899.503941:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24310d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349899.507557:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243722300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659494272:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349899.507607:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349899.508502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349899.509622:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642635904 00000100:00100000:0.0:1783349899.509636:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642635904 00010000:00010000:0.0:1783349899.509852:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceda expref: 39 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349899.509945:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:0.0:1783349899.509955:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+39:2399:x1869977642635904:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349899.509977:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349899.509984:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceda expref: 39 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.509997:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceda expref: 39 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.510018:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e24c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceda expref: 39 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.510051:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:0.0:1783349899.510057:0:7459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.510067:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.510074:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.510123:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349899.510237:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+38:2399:x1869977642635904:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 282us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349899.510245:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00010000:00010000:2.0:1783349899.510304:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.510312:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349899.510330:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783349899.510489:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e24eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee8 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.510505:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee8 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.510512:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349899.510520:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783349899.510523:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ec00, rc 0) 00000100:00100000:2.0:1783349899.510924:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+38:11177:x1869977642635776:12345-192.168.203.50@tcp:101:dd.0 Request processed in 7408us (7583us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1783349899.510932:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:1.0:1783349899.513458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.513581:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642636032 00000100:00100000:3.0:1783349899.513591:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642636032 00000100:00100000:3.0:1783349899.514490:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:3.0:1783349899.514504:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+38:11177:x1869977642636032:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:3.0:1783349899.514533:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349899.514910:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2500 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5deceef expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.514946:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.514959:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.514969:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.515844:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2500 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceef expref: 40 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.515867:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceef expref: 39 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.515877:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349899.515880:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783349899.515883:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030c00, rc 0) 00000100:00100000:3.0:1783349899.515954:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+39:11177:x1869977642636032:12345-192.168.203.50@tcp:101:dd.0 Request processed in 1453us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349899.515963:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:3.0:1783349899.518786:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349899.519384:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642636288 00000100:00100000:0.0:1783349899.519395:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642636288 00000100:00100000:0.0:1783349899.519453:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:0.0:1783349899.519464:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+39:11177:x1869977642636288:12345-192.168.203.50@tcp:36:dd.0 00010000:00010000:0.0:1783349899.519687:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.519702:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.519713:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349899.519755:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1783349899.519776:0:8582:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f2477dea reply state 000000009810e4df transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.519787:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349899.519795:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:0.0:1783349899.519798:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783349899.519801:0:8582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349899.519889:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+42:11177:x1869977642636288:12345-192.168.203.50@tcp:36:dd.0 Request processed in 427us (1112us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1783349899.519912:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00000020:00080000:0.0:1783349899.519916:0:8582:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783349899.652515:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349899.652537:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659494400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349899.652611:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349899.652763:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659494400 00000100:00100000:1.0:1783349899.652770:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659494400 00000100:00100000:1.0:1783349899.652814:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783349899.652823:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659494400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349899.652844:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349899.652882:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659494400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349899.652902:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783349899.653024:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659494528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349899.653051:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349899.653097:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659494400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349899.653158:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659494528 00000100:00100000:1.0:1783349899.653162:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659494528 00000100:00100000:1.0:1783349899.653194:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783349899.653201:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659494528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783349899.653212:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349899.653250:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659494528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349899.653257:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783349899.653659:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659494528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783349899.765407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349899.765513:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642636416 00000100:00100000:2.0:1783349899.765523:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642636416 00000100:00100000:2.0:1783349899.765594:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:2.0:1783349899.765604:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+42:11191:x1869977642636416:12345-192.168.203.50@tcp:101:stat.0 00010000:00010000:2.0:1783349899.765630:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349899.765649:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2515 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decef6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765710:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e251c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765725:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e251c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765734:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e251c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765745:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2523 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765752:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765758:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765859:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765869:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee8 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765876:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765907:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee8 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.765919:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee8 expref: 43 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349899.765933:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a06300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659494656:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349899.766098:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3461e80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349899.787479:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a06300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659494656:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783349899.787510:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349899.788769:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349899.788991:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642636672 00000100:00100000:0.0:1783349899.788999:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642636672 00000100:00100000:0.0:1783349899.789046:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:0.0:1783349899.789054:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+44:6631:x1869977642636672:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783349899.789473:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+45:6631:x1869977642636672:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 417us (708us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1783349899.789481:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:1.0:1783349899.791197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349899.791361:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642636800 00000100:00100000:2.0:1783349899.791370:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642636800 00010000:00010000:2.0:1783349899.791401:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee8 expref: 45 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349899.791436:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:2.0:1783349899.791456:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+45:2399:x1869977642636800:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349899.791470:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349899.791477:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee8 expref: 45 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.791489:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee8 expref: 45 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.791509:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e24f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decee8 expref: 45 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.791524:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349899.791529:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.791548:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.791556:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349899.791593:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349899.791632:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+44:2399:x1869977642636800:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 177us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349899.791639:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00010000:00010000:3.0:1783349899.791738:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791747:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349899.791798:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783349899.791802:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349899.791832:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791844:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791854:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e251c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791860:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e251c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791867:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e251c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791872:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349899.791876:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e251c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791883:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e251c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791891:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:3.0:1783349899.791899:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349899.791903:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e251c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791909:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e251c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791921:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791926:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2523 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791932:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791938:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349899.791940:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791945:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2523 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791952:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310fd00) 00010000:00010000:3.0:1783349899.791954:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349899.791956:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2523 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791962:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524c00/0xd05e6ae1590e2523 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.791985:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524a00/0xd05e6ae1590e2515 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decef6 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.792017:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decef6 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349899.792025:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349899.792027:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349899.792029:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7600, rc 0) 00000100:00100000:3.0:1783349899.792051:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+43:11191:x1869977642636416:12345-192.168.203.50@tcp:101:stat.0 Request processed in 26449us (26656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349899.792057:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:3.0:1783349899.874391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.874432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.874462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349899.874499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349899.874545:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642637056 00000100:00100000:1.0:1783349899.874556:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642637056 00000100:00100000:1.0:1783349899.874632:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642637312 00000100:00100000:1.0:1783349899.874635:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642637312 00000100:00100000:1.0:1783349899.874652:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642637184 00000100:00100000:1.0:1783349899.874655:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642637184 00000100:00100000:1.0:1783349899.874672:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 240 00000100:00100000:1.0:1783349899.874681:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642637056:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349899.874754:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642637056:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 73us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349899.874774:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 240 00000100:00100000:1.0:1783349899.874805:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 241 00000100:00100000:1.0:1783349899.874812:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642637312:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349899.874841:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642637312:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349899.874848:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 241 00000100:00100000:1.0:1783349899.874860:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 242 00000100:00100000:1.0:1783349899.874867:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642637184:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349899.874891:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642637184:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349899.874903:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 242 00000100:00080000:3.0:1783349899.876023:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783349899.876029:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349899.876675:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642636928 00000100:00100000:0.0:1783349899.876685:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642636928 00000100:00100000:0.0:1783349899.876753:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 371 00000100:00100000:0.0:1783349899.876763:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642636928:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349899.876855:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642636928:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 94us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349899.876863:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 371 00000100:00100000:3.0:1783349899.889601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349899.889985:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642637568 00000100:00100000:1.0:1783349899.889996:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642637568 00000100:00100000:1.0:1783349899.890131:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:1.0:1783349899.890175:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+43:11197:x1869977642637568:12345-192.168.203.50@tcp:36:truncate.0 00010000:00010000:1.0:1783349899.890232:0:8582:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349899.890258:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e252a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decef6 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349899.890279:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:1.0:1783349899.890284:0:8582:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349899.890466:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349899.890479:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349899.890503:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783349899.890544:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1783349899.890580:0:8582:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7d4dd82 reply state 00000000bfe6f0a9 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349899.890593:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349899.890599:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:1.0:1783349899.890602:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349899.890604:0:8582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349899.890718:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+45:11197:x1869977642637568:12345-192.168.203.50@tcp:36:truncate.0 Request processed in 545us (1125us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1783349899.890725:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 64 00000020:00080000:1.0:1783349899.890731:0:8582:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783349899.908939:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349900.040586:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.044354:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642637696 00000100:00100000:2.0:1783349900.044369:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642637696 00000100:00100000:2.0:1783349900.044511:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:2.0:1783349900.044522:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+45:11211:x1869977642637696:12345-192.168.203.50@tcp:101:stat.0 00010000:00010000:2.0:1783349900.044575:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349900.044598:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2538 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decefd expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044660:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e253f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044674:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e253f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044686:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e253f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044697:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2546 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044704:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2546 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044711:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2546 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044777:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044786:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044794:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349900.044845:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1783349900.044854:0:12147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349900.044884:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044900:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044908:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e253f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044914:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e253f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044920:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e253f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044926:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349900.044929:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e253f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044937:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e253f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044949:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:2.0:1783349900.044952:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349900.044956:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e253f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044961:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e253f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044975:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2546 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044991:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2546 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.044997:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2546 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.045002:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349900.045005:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2546 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.045012:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2546 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.045019:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310fd00) 00010000:00010000:2.0:1783349900.045022:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349900.045024:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2546 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.045030:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2546 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.045057:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2538 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decefd expref: 47 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.045070:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decefd expref: 46 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.045077:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349900.045079:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349900.045090:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7e00, rc 0) 00000100:00100000:2.0:1783349900.045324:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+46:11211:x1869977642637696:12345-192.168.203.50@tcp:101:stat.0 Request processed in 803us (4748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349900.045330:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:3.0:1783349900.149264:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349900.149387:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642637952 00000100:00100000:1.0:1783349900.149399:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642637952 00000100:00100000:1.0:1783349900.149465:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:1.0:1783349900.149475:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+46:11221:x1869977642637952:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783349900.149495:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349900.149515:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e2554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349900.149640:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783349900.149736:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e2554 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf04 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.149764:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:1.0:1783349900.149768:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349900.149773:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e2554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf04 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.149801:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8cc00, rc 0) 00000100:00100000:1.0:1783349900.149861:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+47:11221:x1869977642637952:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 387us (606us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1783349900.149868:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:1.0:1783349900.152737:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349900.152823:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642638208 00000100:00100000:3.0:1783349900.152835:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642638208 00000100:00100000:3.0:1783349900.152896:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:3.0:1783349900.152907:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+47:11221:x1869977642638208:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1783349900.153186:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+48:11221:x1869977642638208:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 280us (458us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1783349900.153194:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:3.0:1783349900.200194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349900.200316:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642638464 00000100:00100000:1.0:1783349900.200327:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642638464 00000100:00100000:1.0:1783349900.200431:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:1.0:1783349900.200441:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+48:11227:x1869977642638464:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1783349900.200469:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349900.200488:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e2562 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf0b expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.200600:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.200614:0:8582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decefd expref: 49 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.200622:0:8582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.200665:0:8582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decefd expref: 49 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.200677:0:8582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decefd expref: 49 pid: 12147 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349900.200690:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659494784:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349900.200811:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d3780 going to sleep for 11 seconds 00000100:00100000:0.0:1783349900.203327:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659494784:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349900.203356:0:8582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349900.204096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.204283:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642638592 00000100:00100000:2.0:1783349900.204291:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642638592 00010000:00010000:2.0:1783349900.204328:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decefd expref: 50 pid: 12147 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349900.204406:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:2.0:1783349900.204417:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350949850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+50:2400:x1869977642638592:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349900.204434:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349900.204441:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decefd expref: 50 pid: 12147 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.204455:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decefd expref: 50 pid: 12147 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.204474:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e254d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decefd expref: 50 pid: 12147 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.204489:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349900.204494:0:13183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.204504:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.204512:0:13183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.204571:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349900.204624:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350949850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+49:2400:x1869977642638592:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 207us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349900.204632:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00010000:00010000:0.0:1783349900.204715:0:8582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.204723:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349900.204740:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1783349900.204865:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e2562 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf0b expref: 50 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.204881:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf0b expref: 49 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.204888:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:0.0:1783349900.204890:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783349900.204892:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8ca00, rc 0) 00000100:00100000:0.0:1783349900.204915:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+49:11227:x1869977642638464:12345-192.168.203.50@tcp:101:bash.0 Request processed in 4477us (4732us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1783349900.204934:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:1.0:1783349900.207640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.207772:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642638848 00000100:00100000:2.0:1783349900.207791:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642638848 00000100:00100000:2.0:1783349900.207847:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:2.0:1783349900.207857:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+49:11227:x1869977642638848:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:2.0:1783349900.208087:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.208103:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.208115:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349900.208186:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1783349900.208207:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003798c7b8 reply state 0000000073983784 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.208219:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.208226:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349900.208228:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783349900.208230:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349900.208519:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+52:11227:x1869977642638848:12345-192.168.203.50@tcp:36:bash.0 Request processed in 662us (885us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1783349900.208550:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 68 00000020:00080000:2.0:1783349900.208554:0:12147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783349900.214104:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.214216:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642638976 00000100:00100000:2.0:1783349900.214226:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642638976 00000100:00100000:2.0:1783349900.214271:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:2.0:1783349900.214282:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+52:11227:x1869977642638976:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783349900.214305:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349900.214323:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e257e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf12 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.214426:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.214441:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf0b expref: 53 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.214454:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.214487:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf0b expref: 53 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.214504:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf0b expref: 53 pid: 8582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349900.214520:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a05500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1869977659494912:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349900.214611:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3446b40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349900.216528:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349900.216602:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642639104 00000100:00100000:0.0:1783349900.216609:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642639104 00010000:00010000:0.0:1783349900.216641:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf0b expref: 54 pid: 8582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349900.216679:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:0.0:1783349900.216687:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+54:2399:x1869977642639104:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349900.216700:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349900.216717:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf0b expref: 54 pid: 8582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.216730:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf0b expref: 54 pid: 8582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.216748:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:0.0:1783349900.216753:0:7459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.216763:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.216770:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.216793:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349900.216834:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+54:2399:x1869977642639104:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 147us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349900.216842:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00010000:00010000:2.0:1783349900.217506:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2569 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf0b expref: 53 pid: 8582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349900.217526:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a05500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1869977659494912:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783349900.217544:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.217553:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.217659:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349900.217705:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783349900.217709:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349900.217725:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.217752:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e257e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf12 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.217765:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf12 expref: 52 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.217774:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349900.217828:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349900.217832:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7400, rc 0) 00000100:00100000:2.0:1783349900.217903:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+52:11227:x1869977642638976:12345-192.168.203.50@tcp:101:bash.0 Request processed in 3624us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349900.217911:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:3.0:1783349900.219911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.220373:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642639360 00000100:00100000:2.0:1783349900.220381:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642639360 00000100:00100000:2.0:1783349900.220427:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:2.0:1783349900.220436:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+52:11227:x1869977642639360:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:2.0:1783349900.220631:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+53:11227:x1869977642639360:12345-192.168.203.50@tcp:35:bash.0 Request processed in 195us (726us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1783349900.220639:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:1.0:1783349900.264480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349900.264549:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642639616 00000100:00100000:0.0:1783349900.264571:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642639616 00000100:00100000:0.0:1783349900.264658:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:0.0:1783349900.264668:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+53:11237:x1869977642639616:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349900.264690:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349900.264712:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e258c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf19 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349900.264813:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783349900.264919:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e258c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf19 expref: 55 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.264932:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:0.0:1783349900.264935:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349900.264939:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e258c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf19 expref: 55 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.264951:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ee00, rc 0) 00000100:00100000:0.0:1783349900.265007:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+54:11237:x1869977642639616:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 340us (533us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1783349900.265015:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:3.0:1783349900.272490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.272574:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642639744 00000100:00100000:2.0:1783349900.272584:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642639744 00000100:00100000:2.0:1783349900.272718:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:2.0:1783349900.272728:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+54:11237:x1869977642639744:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:2.0:1783349900.272801:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e259a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.272817:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e259a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.272827:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e259a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.272838:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.272844:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.272851:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.272914:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.272935:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.272942:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349900.272985:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.272997:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e259a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273002:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e259a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273008:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e259a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273013:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349900.273016:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e259a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273022:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e259a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273032:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:2.0:1783349900.273035:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349900.273039:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e259a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273044:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e259a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273061:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273066:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273071:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273076:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349900.273078:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273084:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273091:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310fd00) 00010000:00010000:2.0:1783349900.273094:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349900.273097:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273103:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273111:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273115:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273120:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.273131:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349900.274526:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.274546:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.274571:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349900.274574:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349900.274578:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.274585:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349900.274691:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+54:11237:x1869977642639744:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 1960us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349900.274701:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:3.0:1783349900.277747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349900.278506:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642640000 00000100:00100000:0.0:1783349900.278517:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642640000 00000100:00100000:0.0:1783349900.278582:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:0.0:1783349900.278592:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+54:11237:x1869977642640000:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:0.0:1783349900.278805:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+55:11237:x1869977642640000:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 213us (1065us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783349900.278813:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:3.0:1783349900.347931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.348652:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642640256 00000100:00100000:2.0:1783349900.348663:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642640256 00000100:00100000:2.0:1783349900.348734:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:2.0:1783349900.348744:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+55:11240:x1869977642640256:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349900.348767:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349900.348797:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf20 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.348867:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.348896:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.348906:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.348917:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e25bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.348923:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e25bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.348929:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e25bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.349027:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e25c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.349036:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e25c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.349044:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e25c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349900.349054:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783349900.359867:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.359884:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.359892:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.359899:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349900.359903:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.359954:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.359973:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:3.0:1783349900.359976:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349900.359980:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.359986:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e25b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.360023:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e25bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.360030:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e25bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.360036:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e25bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.360042:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349900.360045:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e25bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.360051:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e25bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.360060:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310fd00) 00010000:00010000:3.0:1783349900.360062:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349900.360065:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e25bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.360071:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e25bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.360119:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e25af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf20 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.360179:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e25c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf20 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.360199:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349900.360201:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349900.360204:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6c00, rc 0) 00000100:00100000:3.0:1783349900.360287:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+57:11240:x1869977642640256:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 11544us (12364us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1783349900.360297:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:3.0:1783349900.366250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349900.366485:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642640384 00000100:00100000:0.0:1783349900.366495:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642640384 00000100:00100000:0.0:1783349900.366569:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:0.0:1783349900.366579:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+57:11240:x1869977642640384:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:0.0:1783349900.366655:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e25d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.367380:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e25d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.367412:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e25d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.367448:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e25d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.367455:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e25d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.367462:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e25d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.367468:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ee00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349900.367471:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e25d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.367477:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e25d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.367489:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:0.0:1783349900.367493:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349900.367498:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e25d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.367504:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e25d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349900.368430:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+57:11240:x1869977642640384:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 1844us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349900.368442:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:0.0:1783349900.373074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349900.373168:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642640512 00000100:00100000:1.0:1783349900.373178:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642640512 00000100:00100000:1.0:1783349900.373245:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:1.0:1783349900.373256:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+57:2399:x1869977642640512:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349900.373273:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349900.373312:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e25c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf20 expref: 57 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.373334:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:1.0:1783349900.373339:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349900.373394:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+56:2399:x1869977642640512:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 140us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349900.373402:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:0.0:1783349900.375612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.376088:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642640768 00000100:00100000:2.0:1783349900.376098:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642640768 00000100:00100000:2.0:1783349900.376191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:2.0:1783349900.376201:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+56:11240:x1869977642640768:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349900.376399:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+57:11240:x1869977642640768:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 199us (794us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1783349900.376418:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:3.0:1783349900.554689:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.554778:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642641024 00000100:00100000:2.0:1783349900.554788:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642641024 00000100:00100000:2.0:1783349900.554855:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 74 00000100:00100000:2.0:1783349900.554866:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+57:11258:x1869977642641024:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:2.0:1783349900.554892:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349900.554912:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e25d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf27 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.555014:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e25e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.555029:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e25e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.555049:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e25e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349900.555060:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783349900.555670:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e25d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf27 expref: 60 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.555689:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e25e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf27 expref: 59 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.555697:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349900.555700:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783349900.555703:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6400, rc 0) 00000100:00100000:2.0:1783349900.556113:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+59:11258:x1869977642641024:12345-192.168.203.50@tcp:101:cat.0 Request processed in 1247us (1431us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1783349900.556121:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 74 00000100:00100000:0.0:1783349900.591857:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349900.592160:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642641152 00000100:00100000:3.0:1783349900.592170:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642641152 00000100:00100000:3.0:1783349900.592288:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00100000:3.0:1783349900.592298:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+59:11259:x1869977642641152:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349900.592321:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349900.592340:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e25ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf2e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.592414:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e25f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.592426:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e25f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.592437:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e25f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349900.592475:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783349900.592478:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349900.592509:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e25f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.592533:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e25ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf2e expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.592551:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e25f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf2e expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.592568:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:3.0:1783349900.592571:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349900.592575:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031c00, rc 0) 00000100:00100000:3.0:1783349900.592640:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+60:11259:x1869977642641152:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 344us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349900.592648:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00100000:0.0:1783349900.610970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.611365:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642641536 00000100:00100000:2.0:1783349900.611376:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642641536 00000100:00100000:2.0:1783349900.611436:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:2.0:1783349900.611446:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+60:11259:x1869977642641536:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349900.611735:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+61:11259:x1869977642641536:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 290us (774us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1783349900.611744:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:1.0:1783349900.614818:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.615001:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642641664 00000100:00100000:2.0:1783349900.615018:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642641664 00000100:00100000:2.0:1783349900.615075:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:2.0:1783349900.615085:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+61:11259:x1869977642641664:12345-192.168.203.50@tcp:103:lfs.0 00010000:00010000:2.0:1783349900.615098:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783349900.615121:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2585 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf12 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.615169:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e25e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf27 expref: 60 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.615193:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2482 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dececc expref: 59 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.615205:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349900.615209:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349900.615267:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+58:11259:x1869977642641664:12345-192.168.203.50@tcp:103:lfs.0 Request processed in 183us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349900.615440:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:0.0:1783349900.625483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349900.625674:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642641792 00000100:00100000:1.0:1783349900.625696:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642641792 00000100:00100000:1.0:1783349900.625752:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:1.0:1783349900.625761:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+58:11259:x1869977642641792:12345-192.168.203.50@tcp:58:lfs.0 00010000:00010000:1.0:1783349900.625895:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e25fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.625913:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e25fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.625923:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e25fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349900.626209:0:8582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783349900.626349:0:8582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1783349900.626437:0:8582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1783349900.626519:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+58:11259:x1869977642641792:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 758us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349900.626529:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:1.0:1783349900.656982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.660107:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642641920 00000100:00100000:2.0:1783349900.660121:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642641920 00000100:00100000:2.0:1783349900.660219:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 77 00000100:00100000:2.0:1783349900.660230:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+58:11261:x1869977642641920:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349900.660250:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349900.660270:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2603 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf35 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660478:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e260a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660492:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e260a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660504:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e260a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660514:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2611 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660534:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2611 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660541:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2611 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660618:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660644:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660652:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349900.660705:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783349900.660709:0:12147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349900.660727:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660747:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660757:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e260a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660763:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e260a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660770:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e260a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.660996:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349900.661001:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e260a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661009:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e260a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661021:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:2.0:1783349900.661029:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349900.661036:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e260a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661043:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e260a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661057:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2611 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661063:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2611 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661070:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2611 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661075:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349900.661078:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2611 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661084:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2611 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661092:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310fd00) 00010000:00010000:2.0:1783349900.661095:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349900.661097:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2611 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661103:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2611 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661132:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2603 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf35 expref: 60 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661534:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf35 expref: 59 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.661543:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349900.661546:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349900.661548:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7a00, rc 0) 00000100:00100000:2.0:1783349900.661629:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+59:11261:x1869977642641920:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1401us (4656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349900.661637:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 77 00000040:00080000:0.0:1783349900.740848:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349900.740859:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783349900.740908:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783349900.740917:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783349900.741055:0:13790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243115500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659495040:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783349900.741195:0:13790:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24310df00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349900.745927:0:13790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243115500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659495040:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783349900.766695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349900.767381:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642642048 00000100:00100000:3.0:1783349900.767390:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642642048 00000100:00100000:3.0:1783349900.767447:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:3.0:1783349900.767457:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+59:11272:x1869977642642048:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783349900.767490:0:6517:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783349900.767631:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+59:11272:x1869977642642048:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 175us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349900.767639:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:1.0:1783349900.778037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349900.782662:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642642176 00000100:00100000:3.0:1783349900.782732:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642642176 00000100:00100000:3.0:1783349900.782819:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:3.0:1783349900.782829:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+59:11272:x1869977642642176:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783349900.782929:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e261f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.782947:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e261f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.782961:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e261f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.782975:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2626 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.782981:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.782987:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783013:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783022:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783029:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349900.783072:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783349900.783076:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349900.783088:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783099:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e261f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783113:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e261f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783119:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e261f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783125:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349900.783130:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e261f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783352:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e261f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783367:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:3.0:1783349900.783370:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349900.783374:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e261f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783380:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e261f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783394:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783400:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2626 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783405:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2626 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783410:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349900.783419:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2626 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783426:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2626 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783434:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8ea370dce100) 00010000:00010000:3.0:1783349900.783437:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349900.783440:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2626 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783447:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2626 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783464:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783470:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783476:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783482:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349900.783485:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783490:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783497:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349900.783499:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349900.783510:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.783516:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e262d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349900.783663:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+59:11272:x1869977642642176:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 834us (5632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349900.783673:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:2.0:1783349900.786548:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349900.790616:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642642432 00000100:00100000:3.0:1783349900.790630:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642642432 00000100:00100000:3.0:1783349900.790692:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:3.0:1783349900.790700:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+59:11272:x1869977642642432:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349900.790717:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349900.790733:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2634 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf3c expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790811:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e263b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790822:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e263b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790830:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e263b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349900.790838:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783349900.790896:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e263b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790901:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e263b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790916:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e263b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790920:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349900.790923:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e263b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790927:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e263b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790936:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349900.790938:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349900.790941:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e263b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790945:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e263b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790974:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2634 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf3c expref: 61 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790980:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:3.0:1783349900.790981:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783349900.790984:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2634 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf3c expref: 61 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.790990:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031800, rc 0) 00000100:00100000:3.0:1783349900.791352:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+60:11272:x1869977642642432:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 650us (4826us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1783349900.791369:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:1.0:1783349900.811164:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349900.815967:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642642560 00000100:00100000:3.0:1783349900.815983:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642642560 00000100:00100000:3.0:1783349900.816058:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:3.0:1783349900.816069:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+60:11272:x1869977642642560:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783349900.816106:0:6517:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783349900.816242:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+60:11272:x1869977642642560:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 174us (5087us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349900.816250:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:1.0:1783349900.829819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349900.832916:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642642816 00000100:00100000:3.0:1783349900.832930:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642642816 00000100:00100000:3.0:1783349900.832983:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 82 00000100:00100000:3.0:1783349900.832990:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+60:11272:x1869977642642816:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349900.833007:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349900.833009:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783349900.833029:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e25f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf2e expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.833044:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:3.0:1783349900.833047:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349900.833056:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2649 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783349900.833512:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1783349900.833658:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2650 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.833725:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2650 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.833732:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2650 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.833776:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2649 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf43 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.833790:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2650 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf43 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.833797:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dce100) 00010000:00010000:3.0:1783349900.833800:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349900.833802:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030200, rc 0) 00000100:00100000:3.0:1783349900.833928:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+61:11272:x1869977642642816:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 937us (4118us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1783349900.833936:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 82 00000100:00100000:2.0:1783349900.838320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349900.839278:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642643072 00000100:00100000:3.0:1783349900.839288:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642643072 00000100:00100000:3.0:1783349900.839344:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00100000:3.0:1783349900.839356:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+61:11272:x1869977642643072:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783349900.839407:0:12147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349900.839431:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2650 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf43 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839449:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dce100) 00010000:00010000:3.0:1783349900.839464:0:12147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349900.839483:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e265e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839495:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e265e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839505:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e265e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839536:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2665 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa90b6d26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839544:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa90b6d26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839562:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa90b6d26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839602:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e265e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839610:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e265e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839617:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e265e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839622:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349900.839627:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e265e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839635:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e265e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839651:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:3.0:1783349900.839653:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349900.839657:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e265e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839664:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e265e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839674:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa90b6d26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839681:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2665 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa90b6d26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839687:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2665 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa90b6d26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839692:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349900.839694:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2665 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa90b6d26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839700:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2665 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa90b6d26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839706:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa90b6d26 (ffff8ea370dcef00) 00010000:00010000:3.0:1783349900.839709:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349900.839711:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2665 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa90b6d26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.839717:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2665 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa90b6d26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349900.839804:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+60:11272:x1869977642643072:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 451us (1489us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783349900.839812:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00100000:2.0:1783349900.842991:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349900.843065:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642643200 00000100:00100000:3.0:1783349900.843075:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642643200 00000100:00100000:3.0:1783349900.843133:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 84 00000100:00100000:3.0:1783349900.843174:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+60:11272:x1869977642643200:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349900.843205:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349900.843227:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e266c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf4a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.843258:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.843270:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.843280:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.843372:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e266c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf4a expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.843388:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf4a expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349900.843396:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:3.0:1783349900.843404:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783349900.843408:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030a00, rc 0) 00000100:00100000:3.0:1783349900.843461:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+61:11272:x1869977642643200:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 291us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349900.843468:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 84 00000100:00100000:1.0:1783349900.852897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.853173:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642643456 00000100:00100000:2.0:1783349900.853320:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642643456 00000100:00100000:2.0:1783349900.853375:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 85 00000100:00100000:2.0:1783349900.853385:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+61:11272:x1869977642643456:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783349900.853460:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.853478:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.853489:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783349900.853653:0:8582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1783349900.853663:0:8582:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341648526475ns, next at 342648523652ns, rc = 0 00000004:00010000:2.0:1783349900.853716:0:8582:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7821d23 reply state 00000000f00ae405 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.853729:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.853737:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:2.0:1783349900.853740:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783349900.853743:0:8582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349900.855693:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+63:11272:x1869977642643456:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 2300us (2796us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1783349900.855705:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 85 00000100:00100000:1.0:1783349900.862348:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349900.872510:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642643584 00000100:00100000:0.0:1783349900.872525:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642643584 00000100:00100000:0.0:1783349900.872593:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00100000:0.0:1783349900.872604:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+63:11272:x1869977642643584:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349900.872628:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349900.872650:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2681 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf51 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.872707:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2681 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf51 expref: 64 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.872722:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2681 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf51 expref: 64 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349900.872750:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:0.0:1783349900.872766:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349900.872770:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ee00, rc 0) 00000100:00100000:0.0:1783349900.872837:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+64:11272:x1869977642643584:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 234us (10496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349900.872845:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00100000:0.0:1783349900.882190:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349900.882265:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642643712 00000100:00100000:1.0:1783349900.882274:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642643712 00000100:00100000:1.0:1783349900.882317:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:1.0:1783349900.882325:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1869977642643712:12345-192.168.203.50@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1783349900.882359:0:13811:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:1.0:1783349900.882392:0:13811:0:(genops.c:1406:class_connect()) connect: client 689af055-7605-419d-81ba-26cff8cb556b, cookie 0xd05e6ae1590e2688 00002000:00100000:1.0:1783349900.882404:0:13811:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 689af055-7605-419d-81ba-26cff8cb556b/ffff8ea37f56f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783349900.882421:0:13811:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783349900.882503:0:13811:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783349900.882528:0:13811:0:(import.c:65:import_set_state_nolock()) ffff8ea37f56d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349900.882609:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+6:2398:x1869977642643712:12345-192.168.203.50@tcp:8:lhsmtool_posix.0 Request processed in 283us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349900.882616:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:3.0:1783349900.888203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349900.889035:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642643840 00000100:00100000:0.0:1783349900.889057:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642643840 00000100:00100000:0.0:1783349900.889155:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:0.0:1783349900.889167:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+6:0:x1869977642643840:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1783349900.889283:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1783349900.894692:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1783349900.894705:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000100:00100000:0.0:1783349900.895055:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+5:0:x1869977642643840:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 5885us (6866us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783349900.895067:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:1.0:1783349900.910813:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349900.911719:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642644096 00000100:00100000:0.0:1783349900.911730:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642644096 00000100:00100000:0.0:1783349900.911789:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1783349900.911799:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+64:11272:x1869977642644096:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783349900.912114:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+65:11272:x1869977642644096:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 314us (1309us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1783349900.912127:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1783349900.923480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349900.925855:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642644352 00000100:00100000:3.0:1783349900.925870:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642644352 00000100:00100000:3.0:1783349900.925941:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 87 00000100:00100000:3.0:1783349900.925951:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+65:11272:x1869977642644352:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783349900.926067:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+65:11272:x1869977642644352:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 117us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349900.926074:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 87 00000100:00100000:3.0:1783349900.929999:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.930195:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642644480 00000100:00100000:2.0:1783349900.930205:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642644480 00000100:00100000:2.0:1783349900.930260:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:2.0:1783349900.930270:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+65:11272:x1869977642644480:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349900.930291:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349900.930311:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e268f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.930379:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.930392:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.930404:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349900.930460:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349900.930486:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.930510:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e268f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf58 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.930527:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf58 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349900.930547:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:2.0:1783349900.930559:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783349900.930563:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6e00, rc 0) 00000100:00100000:2.0:1783349900.930630:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+66:11272:x1869977642644480:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 361us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349900.930637:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 88 00010000:00010000:3.0:1783349900.935382:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349900.936480:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349900.936648:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642644608 00000100:00100000:1.0:1783349900.936661:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642644608 00000100:00100000:1.0:1783349900.936734:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:1.0:1783349900.936746:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642644608:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349900.936764:0:9981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349900.936786:0:9981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e269d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf5f expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783349900.936810:0:9981:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc28c, blocks: 0x0 00010000:00010000:1.0:1783349900.936828:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1783349900.936832:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349900.936841:0:9981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e269d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf5f expref: 6 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.940625:0:9981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e269d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf5f expref: 6 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.940658:0:9981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d600, rc 0) 00000100:00100000:1.0:1783349900.940797:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642644608:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 3991us (4260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349900.940807:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:3.0:1783349900.947745:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349900.947823:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642644864 00000100:00100000:1.0:1783349900.947833:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642644864 00000100:00100000:1.0:1783349900.947887:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 89 00000100:00100000:1.0:1783349900.947896:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+66:11272:x1869977642644864:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783349900.947980:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+66:11272:x1869977642644864:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349900.947987:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 89 00000100:00100000:3.0:1783349900.961711:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349900.962621:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642644992 00000100:00100000:1.0:1783349900.962633:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642644992 00000100:00100000:1.0:1783349900.962682:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:1.0:1783349900.962692:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+6:11272:x1869977642644992:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349900.962710:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349900.962727:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.962765:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e269d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf5f expref: 7 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.962788:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349900.962792:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349900.962798:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.962833:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e269d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf5f expref: 7 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.962846:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e269d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf5f expref: 7 pid: 9981 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349900.962860:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1869977659495168:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349900.962948:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349900.966221:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1869977659495168:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349900.966254:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.966419:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c000, rc 0) 00000100:00100000:1.0:1783349900.966479:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+7:11272:x1869977642644992:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 3787us (4777us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349900.966488:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:3.0:1783349900.966540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349900.966802:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642645120 00000100:00100000:1.0:1783349900.966810:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642645120 00010000:00010000:1.0:1783349900.966838:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e269d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf5f expref: 7 pid: 9981 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349900.966885:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:1.0:1783349900.966894:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+7:2399:x1869977642645120:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349900.966908:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349900.966926:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e269d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf5f expref: 7 pid: 9981 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.966939:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e269d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf5f expref: 7 pid: 9981 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.966961:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e269d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf5f expref: 7 pid: 9981 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.966976:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349900.966979:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349900.966986:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.966996:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349900.967041:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349900.967055:0:6504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b86a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1869977659495296:192.168.203.50@tcp:105: 00000100:00100000:1.0:1783349900.967123:0:6504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349900.969890:0:6504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b86a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1869977659495296:192.168.203.50@tcp:105: 00010000:00010000:1.0:1783349900.969913:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349900.969971:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642645120:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 3076us (3438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349900.969980:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:3.0:1783349900.978866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349900.979949:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642645248 00000100:00100000:1.0:1783349900.979961:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642645248 00002000:00100000:1.0:1783349900.980012:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8ea37f5c9500 x1869977642645248/t0(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:651/0 lens 504/0 e 0 to 0 dl 1783349911 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349900.980025:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea37f5c9500 with x1869977642645248 ext(0->8) 00002000:00010000:1.0:1783349900.980031:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea37f5c9500 00000100:00100000:1.0:1783349900.980066:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:1.0:1783349900.980077:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642645248:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783349900.980953:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689af055-7605-419d-81ba-26cff8cb556b+8:2400:x1869977642645248:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 Request processed in 874us (2092us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783349900.980963:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00002000:00100000:1.0:1783349900.980971:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8ea37f5c9500 x1869977642645248/t4294967303(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:651/0 lens 504/448 e 0 to 0 dl 1783349911 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349900.980980:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea37f5c9500 with x1869977642645248 ext(0->8) 00002000:00010000:1.0:1783349900.980985:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea37f5c9500 00000100:00100000:3.0:1783349900.985075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349900.997538:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642645376 00000100:00100000:2.0:1783349900.997562:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642645376 00000100:00100000:3.0:1783349900.997889:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:3.0:1783349900.997900:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+66:11272:x1869977642645376:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783349901.003977:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1783349901.003992:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:2.0:1783349901.004021:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004032:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004038:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004043:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349901.004046:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004051:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783349901.004056:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1783349901.004079:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ea24310fc00) 00000020:00080000:1.0:1783349901.004081:0:6496:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ea3581cf000 refcount 2 committed 0 result 0 batchid 1 00010000:00010000:2.0:1783349901.004082:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349901.004086:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004091:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e23be lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783349901.004095:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36dcf4800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ea3581cf900 00000020:00080000:1.0:1783349901.004100:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36dcf4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ea3517d9600 00010000:00010000:2.0:1783349901.004121:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004126:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004130:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004165:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8de00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349901.004169:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004175:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004189:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:2.0:1783349901.004192:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349901.004195:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004201:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e23c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004229:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004236:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004242:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004247:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349901.004250:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004256:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004264:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310fd00) 00010000:00010000:2.0:1783349901.004268:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349901.004271:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004278:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2404 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004294:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004299:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783349901.004301:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:2.0:1783349901.004303:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004312:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349901.004315:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004318:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004325:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349901.004326:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349901.004328:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004332:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e250e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004349:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004353:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004357:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004360:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ce00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349901.004361:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004365:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004378:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349901.004379:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349901.004381:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004385:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2531 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004393:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004396:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004400:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004404:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349901.004406:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004409:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004414:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:2.0:1783349901.004415:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349901.004416:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004419:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2577 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004435:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004439:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004443:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004446:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349901.004448:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004451:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004455:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:2.0:1783349901.004457:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783349901.004458:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.004461:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e267a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783349901.004473:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783349901.004487:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349901.004505:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659495424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783349901.004587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349901.004719:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659495424 00000100:00100000:0.0:1783349901.004727:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659495424 00000100:00100000:2.0:1783349901.004778:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659495552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783349901.004793:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783349901.004805:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1869977659495424:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783349901.004813:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1783349901.004835:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00000100:00100000:2.0:1783349901.004855:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659495552 00000100:00100000:2.0:1783349901.004861:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659495552 00002000:00010000:0.0:1783349901.004862:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a4bc289, atime: 0x6a4bc28a, ctime: 0x6a4bc289, blocks: 0x8 00010000:00010000:0.0:1783349901.004871:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e26ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349901.004890:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783349901.004901:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659495552:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1783349901.004901:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:0.0:1783349901.004911:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349901.004918:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e26ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.004932:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e26ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.004940:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e26ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.004946:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e26ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.004964:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783349901.004990:0:9981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783349901.004994:0:9981:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783349900 00002000:00010000:2.0:1783349901.004997:0:9981:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783349901.004999:0:9981:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1783349900 -> 1783349900 00002000:00010000:2.0:1783349901.005002:0:9981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1783349901.005044:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1869977659495552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (234us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783349901.005053:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783349901.005070:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1869977659495424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 266us (481us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783349901.005078:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:2.0:1783349901.005097:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea243b24e00/2, rc 0, transno 4294967304 00000100:00080000:0.0:1783349901.005102:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349901.005106:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659495552:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1783349901.005108:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783349901.005120:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:2.0:1783349901.005123:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea37f5c8a80/2, rc 0, transno 4294967302 00010000:00010000:0.0:1783349901.005126:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e26ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349901.005130:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659495424:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783349901.005157:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783349901.005163:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e26ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.005181:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e26ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.005194:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e26ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.005201:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e26ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.005214:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349901.005216:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349901.005218:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349901.005351:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+14:11272:x1869977642645376:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 7451us (20283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.005360:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:1.0:1783349901.021739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.021786:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642645504 00000100:00100000:1.0:1783349901.021796:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642645504 00000100:00100000:1.0:1783349901.021851:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:1.0:1783349901.021862:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+8:2400:x1869977642645504:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783349901.024918:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1783349901.024933:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1783349901.025209:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642645504:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 3343us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349901.025222:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:0.0:1783349901.035314:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.035637:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642645760 00000100:00100000:1.0:1783349901.035649:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642645760 00000100:00100000:1.0:1783349901.035714:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:1.0:1783349901.035724:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+14:11272:x1869977642645760:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783349901.035775:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349901.035801:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2696 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf58 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.035821:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:1.0:1783349901.035826:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349901.035855:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.035868:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.035877:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349901.035997:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000083206426 reply state 00000000b82f9eef transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.036028:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.036035:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:1.0:1783349901.036037:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349901.036040:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:0.0:1783349901.036061:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349901.036217:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+15:11272:x1869977642645760:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 493us (909us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1783349901.036226:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:0.0:1783349901.042317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349901.042397:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642645888 00000100:00100000:2.0:1783349901.042406:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642645888 00000100:00100000:2.0:1783349901.042460:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:2.0:1783349901.042469:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642645888:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783349901.042625:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783349901.042629:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1783349900 -> 1783349899 00002000:00010000:2.0:1783349901.042631:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783349898 00002000:00010000:2.0:1783349901.042645:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1783349900 -> 1783349899 00002000:00010000:2.0:1783349901.042648:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783349901.042710:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642645888:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 242us (402us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783349901.042719:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:1.0:1783349901.047404:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349901.047460:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642646144 00000100:00100000:3.0:1783349901.047470:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642646144 00000100:00100000:3.0:1783349901.047532:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 92 00000100:00100000:3.0:1783349901.047543:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+15:11272:x1869977642646144:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783349901.047621:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.047648:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf4a expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.047658:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.047697:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf4a expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.047711:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf4a expref: 15 pid: 6517 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349901.047726:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659495680:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349901.047808:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea34626b900 going to sleep for 11 seconds 00000100:00100000:1.0:1783349901.049074:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659495680:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349901.049097:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.056248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349901.058959:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642646272 00000100:00100000:3.0:1783349901.058986:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642646272 00010000:00010000:3.0:1783349901.059047:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf4a expref: 16 pid: 6517 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349901.059103:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:3.0:1783349901.059113:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+16:2400:x1869977642646272:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349901.059130:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349901.059158:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf4a expref: 16 pid: 6517 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.059171:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf4a expref: 16 pid: 6517 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.059192:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2673 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf4a expref: 16 pid: 6517 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.059210:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:3.0:1783349901.059215:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.059225:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.059233:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.059259:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349901.059323:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+15:2400:x1869977642646272:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 211us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.059339:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00010000:00010000:1.0:1783349901.061288:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.061305:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.061352:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.061358:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.061366:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.061391:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.061396:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.061404:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.061424:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:1.0:1783349901.061426:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783349901.061431:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.061437:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e26b9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.061564:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+14:11272:x1869977642646144:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 Request processed in 14010us (14156us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783349901.061574:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 92 00000100:00100000:1.0:1783349901.064723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349901.069970:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642646400 00000100:00100000:3.0:1783349901.069992:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642646400 00000100:00100000:3.0:1783349901.070124:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:3.0:1783349901.070158:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642646400:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783349901.070213:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.070236:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.070245:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349901.070250:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349901.070254:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.070295:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.070311:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 7 pid: 8431 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349901.070326:0:13811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13811:1869977659495808:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349901.070437:0:13811:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350a64d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349901.074669:0:13811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13811:1869977659495808:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349901.074697:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349901.075877:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.075962:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642646528 00000100:00100000:0.0:1783349901.075971:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642646528 00010000:00010000:0.0:1783349901.076009:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 8 pid: 8431 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349901.076064:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:0.0:1783349901.076074:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+8:2400:x1869977642646528:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349901.076090:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349901.076110:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 8 pid: 8431 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076124:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 8 pid: 8431 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076168:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f49ae38f/0xd05e6ae1590e26a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf66 expref: 8 pid: 8431 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076186:0:7459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349901.076190:0:7459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349901.076195:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076204:0:7459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076228:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349901.076275:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642646528:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 202us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.076283:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00010000:00010000:0.0:1783349901.076369:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076377:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076396:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076404:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076412:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076419:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030a00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783349901.076422:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076431:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076443:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.076451:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd9d880/0xd05e6ae1590e26c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349901.076515:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642646400:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 6381us (11803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.076524:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:3.0:1783349901.081660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.081972:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642646784 00000100:00100000:0.0:1783349901.081981:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642646784 00000100:00100000:0.0:1783349901.082051:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 93 00000100:00100000:0.0:1783349901.082060:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+14:11272:x1869977642646784:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783349901.082153:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.082172:0:8582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceef expref: 14 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.082182:0:8582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.082217:0:8582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceef expref: 14 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.082230:0:8582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceef expref: 14 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349901.082244:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659495936:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349901.082314:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24310d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783349901.085129:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659495936:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349901.085176:0:8582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.085351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349901.086023:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642646912 00000100:00100000:3.0:1783349901.086031:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642646912 00010000:00010000:3.0:1783349901.086065:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceef expref: 15 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349901.086106:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:3.0:1783349901.086116:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea35094a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+15:2399:x1869977642646912:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349901.086131:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349901.086166:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceef expref: 15 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.086178:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceef expref: 15 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.086200:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2507 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5deceef expref: 15 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.086216:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349901.086221:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.086232:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.086256:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.086282:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349901.086328:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea35094a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+14:2399:x1869977642646912:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 213us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.086336:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00010000:00010000:1.0:1783349901.086647:0:8582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.086656:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.086848:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.086860:0:8582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2681 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf51 expref: 14 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.086874:0:8582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.086900:0:8582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2681 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf51 expref: 14 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.086913:0:8582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2681 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf51 expref: 14 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.086926:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659496064:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349901.086973:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1783349901.090044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349901.090076:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642647040 00000100:00100000:3.0:1783349901.090082:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642647040 00010000:00010000:3.0:1783349901.090113:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2681 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf51 expref: 15 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349901.090159:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:3.0:1783349901.090167:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+15:2400:x1869977642647040:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349901.090180:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349901.090187:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2681 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf51 expref: 15 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.090200:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2681 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf51 expref: 15 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.090220:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:3.0:1783349901.090225:0:13183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.090235:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.090254:0:13183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.090269:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349901.090307:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+15:2400:x1869977642647040:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 140us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.090314:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 63 00010000:00010000:1.0:1783349901.092124:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e2681 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf51 expref: 14 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.092645:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659496064:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349901.092670:0:8582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.092681:0:8582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.092686:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783349901.100383:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1783349901.100582:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1783349901.100620:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1783349901.100730:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8582:1869977659496192:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783349901.100915:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349901.100986:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a900 going to sleep for 11 seconds 00000100:00100000:0.0:1783349901.102869:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659496192 00000100:00100000:0.0:1783349901.102883:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659496192 00000100:00100000:0.0:1783349901.102999:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783349901.103020:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8582:x1869977659496192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783349901.104704:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8582:x1869977659496192:12345-0@lo:1000:mdt00_003.0 Request processed in 1690us (3782us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.104716:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783349901.104974:0:8582:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1783349901.104981:0:8582:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea243b24e00, transno 4294967304 00000100:00100000:1.0:1783349901.104996:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8582:1869977659496192:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1783349901.105493:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1783349901.105628:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8582:1869977659496320:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783349901.105681:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349901.105754:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349901.105985:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659496320 00000100:00100000:0.0:1783349901.105992:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659496320 00000100:00100000:0.0:1783349901.106036:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783349901.106045:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8582:x1869977659496320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783349901.106275:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8582:x1869977659496320:12345-0@lo:1000:mdt00_003.0 Request processed in 231us (592us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783349901.106282:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783349901.106356:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8582:1869977659496320:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1783349901.106392:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106402:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106411:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106417:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.106421:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106436:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106452:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:1.0:1783349901.106455:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783349901.106470:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106477:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ce lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106505:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e25fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106512:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e25fc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106518:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e25fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106523:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8da00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.106526:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e25fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106640:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e25fc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106649:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:1.0:1783349901.106651:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783349901.106655:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e25fc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106661:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e25fc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106701:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106714:0:8582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf35 expref: 17 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106727:0:8582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106750:0:8582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf35 expref: 17 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.106763:0:8582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf35 expref: 17 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.106833:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659496448:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349901.106892:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349901.109386:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659496448:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349901.109412:0:8582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349901.110340:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349901.110781:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642647168 00000100:00100000:3.0:1783349901.110789:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642647168 00010000:00010000:3.0:1783349901.110823:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf35 expref: 18 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349901.110856:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:3.0:1783349901.110864:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+18:2400:x1869977642647168:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349901.110877:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349901.110883:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf35 expref: 18 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.110895:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf35 expref: 18 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.110915:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2618 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf35 expref: 18 pid: 12147 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.110934:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:3.0:1783349901.110939:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.110964:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.110972:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.111019:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349901.111070:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+17:2400:x1869977642647168:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 205us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.111078:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 64 00010000:00010000:0.0:1783349901.111281:0:8582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111288:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111301:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111308:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111314:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111319:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8cc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349901.111323:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111336:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111345:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:0.0:1783349901.111348:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349901.111351:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111357:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e26d5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111368:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111374:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111379:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111383:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3429f1200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349901.111385:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111390:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111396:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea370dceb00) 00010000:00010000:0.0:1783349901.111398:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349901.111401:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.111415:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26c7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783349901.111620:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349901.111625:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783349901.111639:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783349901.111645:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783349901.111708:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+16:11272:x1869977642646784:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 29648us (30055us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1783349901.111717:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 93 00000020:00080000:0.0:1783349901.111721:0:8582:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1783349901.119348:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349901.119420:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642647424 00000100:00100000:2.0:1783349901.119438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642647424 00000100:00100000:2.0:1783349901.119490:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:2.0:1783349901.119500:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+16:11272:x1869977642647424:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783349901.119764:0:6520:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783349901.119808:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1783349901.119840:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.119856:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.119868:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.119876:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.119882:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.119888:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.119909:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783349901.120010:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+18:11272:x1869977642647424:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 510us (671us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1783349901.120018:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000020:00080000:2.0:1783349901.120022:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783349901.120262:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.120270:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.120277:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349901.120281:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.120289:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.120302:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00010000:00010000:3.0:1783349901.120305:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783349901.120309:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.120315:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e26dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.120325:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.120334:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.120336:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783349901.403594:0:14204:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349901.403606:0:14204:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349901.403632:0:14204:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783349901.403642:0:14204:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349901.474636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.475694:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642647680 00000100:00100000:0.0:1783349901.475708:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642647680 00000100:00100000:0.0:1783349901.475770:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 94 00000100:00100000:0.0:1783349901.475779:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+18:11282:x1869977642647680:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349901.475804:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349901.475825:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf6d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.475931:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e26ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.475946:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e26ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.475960:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e26ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349901.475982:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783349901.476079:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e26e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf6d expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.476097:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e26ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf6d expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.476107:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:0.0:1783349901.476110:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783349901.476113:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3429f1800, rc 0) 00000100:00100000:0.0:1783349901.476259:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+20:11282:x1869977642647680:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 480us (1632us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1783349901.476267:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 94 00000100:00100000:0.0:1783349901.480760:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.480888:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642647808 00000100:00100000:1.0:1783349901.480900:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642647808 00000100:00100000:1.0:1783349901.480968:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:1.0:1783349901.480980:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+20:11282:x1869977642647808:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:1.0:1783349901.481510:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e26f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.481595:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e26f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.481683:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e26f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.481705:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.481712:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.481719:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.481918:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.481927:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.481934:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349901.481995:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482010:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e26f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482018:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e26f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482027:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e26f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482045:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8da00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.482050:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e26f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482058:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e26f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482072:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349901.482076:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349901.482081:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e26f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482087:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e26f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482099:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482105:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482111:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482117:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.482120:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482126:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482324:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310fe00) 00010000:00010000:1.0:1783349901.482328:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349901.482331:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482339:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e26ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482360:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482367:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482373:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482380:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.482383:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482390:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482398:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea24310fb00) 00010000:00010000:1.0:1783349901.482400:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349901.482403:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.482408:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2706 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.482594:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+20:11282:x1869977642647808:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 1610us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.482608:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:3.0:1783349901.510535:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.510815:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642648064 00000100:00100000:0.0:1783349901.510825:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642648064 00000100:00100000:0.0:1783349901.510919:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:0.0:1783349901.510929:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+20:11285:x1869977642648064:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349901.510950:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349901.510970:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e270d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf74 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.511055:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2714 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.511070:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2714 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.511091:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2714 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.511108:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e271b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.511116:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e271b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.511123:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e271b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.512916:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.512934:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.512944:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349901.512955:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783349901.513031:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2714 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513039:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2714 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513046:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2714 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513052:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349901.513061:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2714 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513069:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2714 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513080:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:0.0:1783349901.513083:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349901.513088:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2714 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513094:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2714 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513105:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e271b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513111:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e271b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513116:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e271b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513121:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349901.513123:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e271b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513129:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e271b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513154:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea343b1ed00) 00010000:00010000:0.0:1783349901.513157:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349901.513168:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e271b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513174:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e271b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513225:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1200/0xd05e6ae1590e270d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf74 expref: 23 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513240:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf74 expref: 22 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.513246:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:0.0:1783349901.513249:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349901.513251:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b200, rc 0) 00000100:00100000:0.0:1783349901.513335:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+22:11285:x1869977642648064:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 2406us (2807us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1783349901.513344:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:2.0:1783349901.515916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.516044:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642648192 00000100:00100000:0.0:1783349901.516054:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642648192 00000100:00100000:0.0:1783349901.516171:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 97 00000100:00100000:0.0:1783349901.516182:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+22:11285:x1869977642648192:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:0.0:1783349901.516241:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2730 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.516257:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.516268:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.516454:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.516462:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2730 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.516469:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.516475:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364be00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349901.516479:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.516485:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2730 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.516496:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:0.0:1783349901.516500:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349901.516505:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2730 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.516511:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2730 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349901.516586:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+22:11285:x1869977642648192:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 406us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.516594:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 97 00000100:00100000:0.0:1783349901.518620:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349901.518768:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642648448 00000100:00100000:2.0:1783349901.518886:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642648448 00000100:00100000:2.0:1783349901.518973:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:2.0:1783349901.518982:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+22:11285:x1869977642648448:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349901.519282:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+23:11285:x1869977642648448:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 301us (667us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1783349901.519290:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:3.0:1783349901.574938:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.576370:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642648704 00000100:00100000:1.0:1783349901.576383:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642648704 00000100:00100000:0.0:1783349901.576500:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 98 00000100:00100000:0.0:1783349901.576510:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+23:10813:x1869977642648704:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349901.576542:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349901.576572:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2737 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.576677:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.576691:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf74 expref: 24 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.576700:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.576730:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf74 expref: 24 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.576743:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf74 expref: 24 pid: 8582 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349901.576759:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a1bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659496576:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349901.576851:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242708840 going to sleep for 11 seconds 00000100:00100000:1.0:1783349901.579273:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a1bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659496576:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349901.579300:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349901.581438:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.581534:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642648832 00000100:00100000:1.0:1783349901.581556:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642648832 00010000:00010000:1.0:1783349901.581595:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf74 expref: 25 pid: 8582 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.581636:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:1.0:1783349901.581645:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+25:2399:x1869977642648832:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349901.581661:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349901.581668:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf74 expref: 25 pid: 8582 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.581681:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf74 expref: 25 pid: 8582 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.581703:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2722 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf74 expref: 25 pid: 8582 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.581719:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:1.0:1783349901.581737:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.581747:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.581754:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.581779:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349901.581823:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+24:2399:x1869977642648832:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 178us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.581830:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00010000:00010000:1.0:1783349901.581856:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.581862:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349901.581878:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1783349901.582009:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2737 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf7b expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.582024:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf7b expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.582032:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:1.0:1783349901.582034:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783349901.582037:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b800, rc 0) 00000100:00100000:1.0:1783349901.582060:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+24:10813:x1869977642648704:12345-192.168.203.50@tcp:101:bash.0 Request processed in 5552us (7132us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1783349901.582073:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 98 00000100:00100000:0.0:1783349901.596121:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.596232:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642648960 00000100:00100000:1.0:1783349901.596243:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642648960 00000100:00100000:1.0:1783349901.596303:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:1.0:1783349901.596312:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+24:10813:x1869977642648960:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1783349901.596335:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349901.596354:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e274c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf82 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.596388:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2753 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.596401:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2753 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.596413:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2753 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.596524:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e274c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf82 expref: 26 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.596638:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2753 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf82 expref: 25 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.596648:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:1.0:1783349901.596651:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783349901.596654:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8da00, rc 0) 00000100:00100000:1.0:1783349901.596759:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+25:10813:x1869977642648960:12345-192.168.203.50@tcp:101:bash.0 Request processed in 447us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.596773:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:3.0:1783349901.599255:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.599590:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642649216 00000100:00100000:0.0:1783349901.599600:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642649216 00000100:00100000:0.0:1783349901.599663:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:0.0:1783349901.599674:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+25:10813:x1869977642649216:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:0.0:1783349901.600184:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.600221:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.600232:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349901.600279:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1783349901.600301:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b83c8b55 reply state 0000000014c6e192 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.600314:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.600322:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:0.0:1783349901.600325:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783349901.600328:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1783349901.600400:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1783349901.600496:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+29:10813:x1869977642649216:12345-192.168.203.50@tcp:36:bash.0 Request processed in 824us (1248us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1783349901.600504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 100 00000020:00080000:0.0:1783349901.600509:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1783349901.602408:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.602484:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642649344 00000100:00100000:0.0:1783349901.602493:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642649344 00000100:00100000:0.0:1783349901.602563:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00100000:0.0:1783349901.602574:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+29:10813:x1869977642649344:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349901.602594:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349901.602614:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2761 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.602679:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2761 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf89 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.602693:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2761 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf89 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.602710:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:0.0:1783349901.602712:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349901.602715:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364ac00, rc 0) 00000100:00100000:0.0:1783349901.602792:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+30:10813:x1869977642649344:12345-192.168.203.50@tcp:101:bash.0 Request processed in 220us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.602800:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00100000:2.0:1783349901.605735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.606070:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642649472 00000100:00100000:1.0:1783349901.606080:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642649472 00000100:00100000:1.0:1783349901.606190:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:1.0:1783349901.606200:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+6:10813:x1869977642649472:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1783349901.606217:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349901.606235:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e2768 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf90 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783349901.606258:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a4bc28b, atime: 0x6a4bc28a, ctime: 0x6a4bc28b, blocks: 0x8 00010000:00010000:1.0:1783349901.606281:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1783349901.606285:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349901.606293:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e2768 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf90 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.606310:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e2768 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf90 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.606322:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d600, rc 0) 00000100:00100000:1.0:1783349901.606383:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+7:10813:x1869977642649472:12345-192.168.203.50@tcp:101:bash.0 Request processed in 184us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.606391:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:3.0:1783349901.608575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.608684:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642649600 00000100:00100000:0.0:1783349901.608694:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642649600 00002000:00010000:0.0:1783349901.608732:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1783349901.608737:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea37f5cb480 with x1869977642649600 ext(0->18446744073709551615) 00002000:00010000:0.0:1783349901.608748:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea37f5cb480. 00000100:00100000:0.0:1783349901.608789:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:0.0:1783349901.608800:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:689af055-7605-419d-81ba-26cff8cb556b+7:2401:x1869977642649600:12345-192.168.203.50@tcp:10:bash.0 00002000:00010000:0.0:1783349901.609070:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783349901.609074:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1783349899 -> 1783349900 00002000:00010000:0.0:1783349901.609076:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1783349898 -> 1783349898 00002000:00010000:0.0:1783349901.609079:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1783349899 -> 1783349900 00002000:00010000:0.0:1783349901.609081:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1783349901.609160:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:689af055-7605-419d-81ba-26cff8cb556b+8:2401:x1869977642649600:12345-192.168.203.50@tcp:10:bash.0 Request processed in 336us (566us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783349901.609178:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00002000:00010000:0.0:1783349901.609182:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1783349901.609185:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea37f5cb480 with x1869977642649600 ext(0->18446744073709551615) 00002000:00010000:0.0:1783349901.609190:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea37f5cb480. 00000100:00100000:3.0:1783349901.676325:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.676448:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642649728 00000100:00100000:1.0:1783349901.676458:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642649728 00000100:00100000:1.0:1783349901.676567:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 102 00000100:00100000:1.0:1783349901.676578:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+30:11299:x1869977642649728:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:1.0:1783349901.676662:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e276f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676680:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e276f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676692:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e276f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676708:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2776 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676715:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676722:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676786:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676795:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676802:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349901.676858:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676869:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e276f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676885:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e276f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676891:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e276f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676898:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8dc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.676902:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e276f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676909:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e276f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676920:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349901.676924:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349901.676927:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e276f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676934:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e276f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676947:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676953:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2776 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676958:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2776 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.676963:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ca00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.676971:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2776 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.677231:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2776 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.677241:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310ff00) 00010000:00010000:1.0:1783349901.677244:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349901.677247:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2776 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.677253:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2776 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.677269:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.677274:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.677280:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.677284:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.677287:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.677292:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.677298:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:1.0:1783349901.677301:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349901.677311:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.677316:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e277d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.677393:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+30:11299:x1869977642649728:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 815us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.677401:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 102 00000100:00100000:3.0:1783349901.701414:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659496704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783349901.701493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349901.701578:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659496704 00000100:00100000:3.0:1783349901.701585:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659496704 00000100:00100000:3.0:1783349901.701625:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783349901.701633:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659496704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783349901.701664:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1783349901.701706:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659496704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.701713:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783349901.701753:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659496704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783349901.728326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.728501:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642649984 00000100:00100000:0.0:1783349901.728511:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642649984 00000100:00100000:0.0:1783349901.728579:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 103 00000100:00100000:0.0:1783349901.728590:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+30:11302:x1869977642649984:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349901.728610:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349901.728630:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2784 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728699:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e278b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728713:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e278b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728725:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e278b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728739:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2792 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728746:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728752:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728862:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2799 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728874:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728881:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349901.728890:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783349901.728960:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e278b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728968:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e278b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728974:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e278b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728979:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349901.728983:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e278b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.728990:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e278b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729002:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:0.0:1783349901.729157:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349901.729164:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e278b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729183:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e278b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729196:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729202:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2792 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729208:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2792 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729213:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349901.729217:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2792 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729223:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2792 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729231:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea343b1ed00) 00010000:00010000:0.0:1783349901.729234:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349901.729237:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2792 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729242:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2792 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729281:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2784 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf97 expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729294:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2799 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf97 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.729307:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:0.0:1783349901.729310:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783349901.729312:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364ba00, rc 0) 00000100:00100000:0.0:1783349901.729435:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+32:11302:x1869977642649984:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 845us (1117us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1783349901.729443:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 103 00000100:00100000:2.0:1783349901.736633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.736726:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642650112 00000100:00100000:1.0:1783349901.736737:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642650112 00000100:00100000:1.0:1783349901.736788:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 104 00000100:00100000:1.0:1783349901.736797:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+32:11302:x1869977642650112:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:1.0:1783349901.736858:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.736874:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf7b expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.736884:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.736916:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf7b expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.736929:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf7b expref: 32 pid: 6519 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.736942:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1869977659496832:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349901.737072:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349901.744559:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.744683:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1869977659496832:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349901.744708:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349901.744821:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642650368 00000100:00100000:0.0:1783349901.744829:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642650368 00000100:00100000:0.0:1783349901.744882:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:0.0:1783349901.744891:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+33:6165:x1869977642650368:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783349901.745180:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+34:6165:x1869977642650368:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 288us (641us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1783349901.745188:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:3.0:1783349901.746868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.747169:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642650496 00000100:00100000:0.0:1783349901.747178:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642650496 00010000:00010000:0.0:1783349901.747211:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf7b expref: 34 pid: 6519 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349901.747247:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:0.0:1783349901.747257:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+34:2399:x1869977642650496:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349901.747270:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349901.747277:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf7b expref: 34 pid: 6519 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.747289:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf7b expref: 34 pid: 6519 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.747324:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e273e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf7b expref: 34 pid: 6519 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.747341:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:0.0:1783349901.747345:0:7459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.747355:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.747361:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.747391:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349901.747441:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+33:2399:x1869977642650496:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 185us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.747448:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 66 00010000:00010000:1.0:1783349901.747510:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.747518:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.747567:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.747574:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.747580:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.747585:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.747588:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.747594:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.747601:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:1.0:1783349901.747604:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349901.747607:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.747621:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.747656:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+32:11302:x1869977642650112:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 10861us (11033us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.747664:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 104 00000100:00100000:3.0:1783349901.749939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.750031:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642650752 00000100:00100000:0.0:1783349901.750040:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642650752 00000100:00100000:0.0:1783349901.750095:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:0.0:1783349901.750105:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+32:11302:x1869977642650752:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:0.0:1783349901.750341:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+33:11302:x1869977642650752:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 237us (409us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1783349901.750349:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:2.0:1783349901.824096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.824235:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642651008 00000100:00100000:1.0:1783349901.824245:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642651008 00000100:00100000:1.0:1783349901.824300:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 105 00000100:00100000:1.0:1783349901.824309:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+33:11313:x1869977642651008:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:1.0:1783349901.824332:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349901.824350:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decf9e expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824417:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824431:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824442:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824455:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824463:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824501:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824612:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e27c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824621:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e27c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824628:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e27c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349901.824754:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1783349901.824837:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824845:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824851:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824857:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ca00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.824861:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824868:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824878:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349901.824882:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349901.824893:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824900:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824915:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824921:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824926:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824930:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8dc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.824933:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824939:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824947:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea24310ff00) 00010000:00010000:1.0:1783349901.824949:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349901.824951:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824956:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.824996:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf9e expref: 36 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.825133:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e27c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf9e expref: 35 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.825191:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:1.0:1783349901.825193:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349901.825196:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8cc00, rc 0) 00000100:00100000:1.0:1783349901.825254:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+35:11313:x1869977642651008:12345-192.168.203.50@tcp:101:cat.0 Request processed in 946us (1167us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1783349901.825262:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 105 00000100:00100000:3.0:1783349901.831237:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.831484:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642651264 00000100:00100000:0.0:1783349901.831494:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642651264 00000100:00100000:0.0:1783349901.831941:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:0.0:1783349901.831965:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+35:11313:x1869977642651264:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:0.0:1783349901.832286:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+36:11313:x1869977642651264:12345-192.168.203.50@tcp:35:cat.0 Request processed in 323us (1057us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1783349901.832294:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:3.0:1783349901.856598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349901.856808:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642651520 00000100:00100000:2.0:1783349901.856820:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642651520 00000100:00100000:2.0:1783349901.856897:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 106 00000100:00100000:2.0:1783349901.856907:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+36:11314:x1869977642651520:12345-192.168.203.50@tcp:36:rm.0 00010000:00010000:2.0:1783349901.856970:0:12147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1783349901.857007:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2761 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf89 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.857030:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e27c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf9e expref: 35 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.857069:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2799 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf97 expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.857081:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2753 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf82 expref: 33 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.857101:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:2.0:1783349901.857107:0:12147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349901.857762:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e27d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.857893:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e27d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.857904:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e27d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.857925:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.857933:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.857939:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.858034:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e27df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.858042:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e27df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.858059:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e27df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783349901.861376:0:12147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1783349901.861391:0:12147:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342656254382ns, next at 343656251565ns, rc = 0 00010000:00010000:2.0:1783349901.861455:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862001:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862017:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862026:0:12147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862033:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862039:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862062:0:12147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349901.862084:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e27df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862100:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e27df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862106:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e27df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862126:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349901.862131:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e27df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862162:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e27df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862175:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:2.0:1783349901.862179:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783349901.862183:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e27df lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862190:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e27df lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862209:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e27d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862216:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e27d1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862222:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e27d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862227:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349901.862229:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e27d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862235:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e27d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862253:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:2.0:1783349901.862255:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349901.862258:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e27d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862263:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e27d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349901.862273:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a16c8e3 reply state 0000000028177787 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862282:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.862287:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea2424c5600) 00010000:00010000:2.0:1783349901.862290:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783349901.862292:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349901.862370:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+34:11314:x1869977642651520:12345-192.168.203.50@tcp:36:rm.0 Request processed in 5461us (5791us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1783349901.862378:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 106 00010000:00010000:3.0:1783349901.866669:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.866695:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.866705:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7e00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349901.866710:0:7458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.866719:0:7458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.866737:0:7458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:3.0:1783349901.866740:0:7458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783349901.866745:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.866751:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e27e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.866765:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.866777:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.866778:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349901.898295:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.898402:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642651776 00000100:00100000:1.0:1783349901.898411:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642651776 00000100:00100000:1.0:1783349901.898476:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 107 00000100:00100000:1.0:1783349901.898486:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+34:11320:x1869977642651776:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1783349901.898509:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349901.898529:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27ed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfa5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.898669:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.898683:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.898694:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.898706:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.898726:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.898733:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783349901.899037:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1783349901.899203:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899212:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899220:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899249:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899256:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27f4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899263:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899269:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8dc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349901.899272:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899280:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899303:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349901.899306:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349901.899310:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899317:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e27f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349901.899329:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4b40ee3 reply state 000000005a692119 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899339:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899344:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea2424c5600) 00010000:00010000:1.0:1783349901.899346:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349901.899349:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783349901.899375:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e27ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfa5 expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899389:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfa5 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.899395:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310ff00) 00010000:00010000:1.0:1783349901.899398:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349901.899400:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c000, rc 0) 00000100:00100000:1.0:1783349901.899465:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+37:11320:x1869977642651776:12345-192.168.203.50@tcp:101:bash.0 Request processed in 981us (1179us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1783349901.899473:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 107 00000100:00100000:0.0:1783349901.904445:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349901.904922:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642651904 00000100:00100000:2.0:1783349901.904933:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642651904 00000100:00100000:2.0:1783349901.905019:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:2.0:1783349901.905030:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642651904:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783349901.905048:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349901.905071:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054adef4e/0xd05e6ae1590e2810 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfac expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349901.905101:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783349901.905155:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1783349901.905160:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.905170:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054adef4e/0xd05e6ae1590e2810 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfac expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.905188:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054adef4e/0xd05e6ae1590e2810 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfac expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.905202:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6c00, rc 0) 00000100:00100000:2.0:1783349901.905256:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+8:2402:x1869977642651904:12345-192.168.203.50@tcp:101:bash.0 Request processed in 228us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349901.905264:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00080000:3.0:1783349901.906887:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349901.909079:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349901.909179:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642652032 00000100:00100000:0.0:1783349901.909189:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642652032 00000100:00100000:0.0:1783349901.909249:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:0.0:1783349901.909259:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+8:11320:x1869977642652032:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349901.909278:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349901.909294:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfb3 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.909324:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054adef4e/0xd05e6ae1590e2810 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfac expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.909333:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349901.909337:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349901.909343:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 9 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.909374:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054adef4e/0xd05e6ae1590e2810 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfac expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.909387:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054adef4e/0xd05e6ae1590e2810 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfac expref: 9 pid: 8433 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349901.909420:0:13811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13811:1869977659496960:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349901.909508:0:13811:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242708000 going to sleep for 11 seconds 00000100:00100000:2.0:1783349901.913021:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349901.913100:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642652160 00000100:00100000:1.0:1783349901.913109:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642652160 00010000:00010000:1.0:1783349901.913165:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054adef4e/0xd05e6ae1590e2810 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfac expref: 10 pid: 8433 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.913207:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:1.0:1783349901.913217:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+10:2399:x1869977642652160:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349901.913251:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349901.913272:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054adef4e/0xd05e6ae1590e2810 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfac expref: 10 pid: 8433 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.913286:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054adef4e/0xd05e6ae1590e2810 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfac expref: 10 pid: 8433 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.913313:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349901.913317:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349901.913324:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 10 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.913334:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 10 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.913368:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 10 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349901.913381:0:6504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b87100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6504:1869977659497088:192.168.203.50@tcp:105: 00000100:00100000:1.0:1783349901.913463:0:6504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a480 going to sleep for 11 seconds 00010000:00010000:0.0:1783349901.913683:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054adef4e/0xd05e6ae1590e2810 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfac expref: 10 pid: 8433 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349901.913698:0:13811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13811:1869977659496960:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349901.913724:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 9 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.913735:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364aa00, rc 0) 00000100:00100000:0.0:1783349901.913762:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+9:11320:x1869977642652032:12345-192.168.203.50@tcp:101:bash.0 Request processed in 4505us (4692us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.913770:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:1.0:1783349901.923401:0:6504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b87100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6504:1869977659497088:192.168.203.50@tcp:105: 00010000:00010000:1.0:1783349901.923426:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349901.923487:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642652160:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 10271us (10474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.923498:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:3.0:1783349901.924250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349901.924319:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642652416 00000100:00100000:2.0:1783349901.924326:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642652416 00000100:00100000:2.0:1783349901.924375:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:2.0:1783349901.924385:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+37:11320:x1869977642652416:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:2.0:1783349901.924961:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+38:11320:x1869977642652416:12345-192.168.203.50@tcp:35:bash.0 Request processed in 576us (712us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1783349901.924970:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00010000:00010000:0.0:1783349901.956365:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349902.027083:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.027358:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642652544 00000100:00100000:0.0:1783349902.027369:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642652544 00000100:00100000:1.0:1783349902.027565:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 108 00000100:00100000:1.0:1783349902.027575:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+38:11336:x1869977642652544:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783349902.027796:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349902.027819:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e281e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.027882:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2825 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.027896:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2825 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.027908:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2825 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349902.027948:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783349902.027952:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783349902.027982:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2825 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.028007:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e281e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfba expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.028248:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2825 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfba expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.028256:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349902.028259:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349902.028262:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8dc00, rc 0) 00000100:00100000:1.0:1783349902.028415:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+39:11336:x1869977642652544:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 840us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349902.028423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 108 00000100:00100000:3.0:1783349902.033200:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349902.035457:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642652800 00000100:00100000:2.0:1783349902.035471:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642652800 00000100:00100000:2.0:1783349902.035580:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 109 00000100:00100000:2.0:1783349902.035590:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+39:11336:x1869977642652800:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349902.035609:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349902.035641:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e282c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfc1 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.035746:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2833 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.035759:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.035781:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349902.035792:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783349902.035896:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7600/0xd05e6ae1590e282c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfc1 expref: 42 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.035914:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2833 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfc1 expref: 41 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.035922:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310ff00) 00010000:00010000:2.0:1783349902.035925:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349902.035928:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6c00, rc 0) 00000100:00100000:2.0:1783349902.035991:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+41:11336:x1869977642652800:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 402us (2800us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1783349902.035999:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 109 00000100:00100000:3.0:1783349902.041844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.041957:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642652928 00000100:00100000:0.0:1783349902.041967:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642652928 00000100:00100000:0.0:1783349902.042036:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1783349902.042047:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+41:2399:x1869977642652928:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349902.042085:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349902.042107:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2833 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfc1 expref: 41 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.042173:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310ff00) 00010000:00010000:0.0:1783349902.042177:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349902.042237:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+40:2399:x1869977642652928:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 192us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349902.042244:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1783349902.042741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.042846:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642653184 00000100:00100000:0.0:1783349902.042851:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642653184 00000100:00100000:0.0:1783349902.042895:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 110 00000100:00100000:0.0:1783349902.042903:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+40:11336:x1869977642653184:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349902.042921:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349902.042935:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2841 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfc8 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.043125:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2848 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.043183:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2848 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.043192:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2848 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349902.043203:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783349902.045091:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2841 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfc8 expref: 43 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.045126:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2848 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfc8 expref: 42 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.045184:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310ff00) 00010000:00010000:0.0:1783349902.045186:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783349902.045189:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a400, rc 0) 00000100:00100000:0.0:1783349902.046182:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+42:11336:x1869977642653184:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 3276us (3437us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1783349902.046205:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 110 00000100:00100000:2.0:1783349902.060308:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349902.060407:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642653312 00000100:00100000:1.0:1783349902.060417:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642653312 00000100:00100000:1.0:1783349902.060475:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:1.0:1783349902.060486:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+8:2401:x1869977642653312:12345-192.168.203.50@tcp:1:lfs.0 00010000:00010000:1.0:1783349902.060530:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.060562:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 8 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.060571:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349902.060575:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783349902.060580:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.060615:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 8 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.060642:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 8 pid: 13811 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349902.060657:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1869977659497216:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349902.060748:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349902.068411:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349902.068556:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1869977659497216:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349902.068582:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349902.068674:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642653440 00000100:00100000:0.0:1783349902.068682:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642653440 00002000:00100000:0.0:1783349902.068728:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8ea243203800 x1869977642653440/t0(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:653/0 lens 504/0 e 0 to 0 dl 1783349913 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783349902.068739:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea243203800 with x1869977642653440 ext(0->8) 00010000:00010000:0.0:1783349902.068746:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 9 pid: 13811 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.068761:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 9 pid: 13811 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349902.068768:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ea243203800 00000100:00100000:0.0:1783349902.068838:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:0.0:1783349902.068847:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689af055-7605-419d-81ba-26cff8cb556b+9:2400:x1869977642653440:12345-192.168.203.50@tcp:4:lfs.0 00000100:00100000:0.0:1783349902.069827:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689af055-7605-419d-81ba-26cff8cb556b+11:2400:x1869977642653440:12345-192.168.203.50@tcp:4:lfs.0 Request processed in 976us (1421us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1783349902.069835:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00002000:00100000:0.0:1783349902.069843:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8ea243203800 x1869977642653440/t4294967303(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:653/0 lens 504/448 e 0 to 0 dl 1783349913 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783349902.069860:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea243203800 with x1869977642653440 ext(0->8) 00010000:00010000:0.0:1783349902.069868:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 11 pid: 13811 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.069881:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 11 pid: 13811 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349902.069888:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ea243203800 00000100:00100000:3.0:1783349902.074052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349902.074517:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642653568 00000100:00100000:2.0:1783349902.074526:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642653568 00010000:00010000:3.0:1783349902.074696:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 11 pid: 13811 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349902.074795:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:3.0:1783349902.074805:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350949450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+11:2399:x1869977642653568:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349902.074820:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783349902.074835:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783349902.074838:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783349901 00002000:00010000:3.0:1783349902.074840:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783349901 00002000:00010000:3.0:1783349902.074854:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1783349901 00002000:00010000:3.0:1783349902.074857:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783349902.074863:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 11 pid: 13811 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.074876:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 11 pid: 13811 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.074997:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042d46274/0xd05e6ae1590e2817 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfb3 expref: 11 pid: 13811 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.075015:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349902.075019:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349902.075024:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.075034:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.075079:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349902.075207:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350949450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+10:2399:x1869977642653568:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 403us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349902.075215:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 68 00010000:00010000:1.0:1783349902.075302:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.075312:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.075331:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.075340:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.075349:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.075367:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783349902.075371:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.075381:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.075393:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.075400:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023edaa8e/0xd05e6ae1590e2856 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349902.075443:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+9:2401:x1869977642653312:12345-192.168.203.50@tcp:1:lfs.0 Request processed in 14959us (15145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349902.075450:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:2.0:1783349902.077567:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.077657:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642653824 00000100:00100000:0.0:1783349902.077666:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642653824 00000100:00100000:0.0:1783349902.077715:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:0.0:1783349902.077724:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+42:11336:x1869977642653824:12345-192.168.203.50@tcp:35:lfs.0 00000004:00010000:0.0:1783349902.077781:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2848 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfc8 expref: 42 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349902.078120:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1783349902.078294:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1783349902.078598:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1783349902.078637:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.078653:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfa5 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.078662:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.078704:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfa5 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.078719:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfa5 expref: 46 pid: 6518 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349902.078733:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1869977659497344:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349902.078985:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3446b4240 going to sleep for 11 seconds 00000100:00100000:3.0:1783349902.086914:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1869977659497344:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349902.086944:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349902.089386:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349902.089508:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642653952 00000100:00100000:1.0:1783349902.089518:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642653952 00010000:00010000:1.0:1783349902.089573:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfa5 expref: 47 pid: 6518 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349902.089612:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:1.0:1783349902.089621:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+47:2400:x1869977642653952:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349902.089635:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349902.089642:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfa5 expref: 47 pid: 6518 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.089664:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfa5 expref: 47 pid: 6518 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.089686:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2802 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfa5 expref: 47 pid: 6518 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.089703:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310ff00) 00010000:00010000:1.0:1783349902.089709:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.089718:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.089727:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.089756:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349902.089814:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+46:2400:x1869977642653952:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 194us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349902.089822:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 69 00010000:00010000:3.0:1783349902.089858:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.089869:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783349902.089976:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1783349902.090121:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1783349902.090986:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659497472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783349902.091031:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349902.091059:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350a64000 going to sleep for 11 seconds 00000100:00100000:2.0:1783349902.091110:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659497472 00000100:00100000:2.0:1783349902.091118:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659497472 00000100:00100000:2.0:1783349902.091193:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783349902.091202:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1869977659497472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783349902.091303:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1869977659497472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349902.091310:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783349902.091437:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659497472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783349902.091565:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1783349902.091617:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659497600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783349902.091650:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349902.091669:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3446b4240 going to sleep for 11 seconds 00000100:00100000:3.0:1783349902.091673:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659497600 00000100:00100000:3.0:1783349902.091678:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659497600 00000100:00100000:3.0:1783349902.091734:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783349902.091741:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1869977659497600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783349902.092017:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6521:x1869977659497600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 276us (365us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783349902.092023:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783349902.092512:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659497600:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783349902.092567:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1783349902.092602:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.092613:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.092621:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.092627:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349902.092738:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.092754:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.092781:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310ff00) 00010000:00010000:0.0:1783349902.092785:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783349902.092790:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.092797:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e285d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783349902.092893:0:6521:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783349902.092950:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1783349902.092962:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342887825382ns, next at 343887823335ns, rc = 0 00000001:00080000:0.0:1783349902.092968:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1783349902.093327:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310ff00) 00010000:00010000:0.0:1783349902.093331:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783349902.093339:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2848 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfc8 expref: 50 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349902.093452:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+49:11336:x1869977642653824:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 15728us (15891us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1783349902.093462:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 26 00000020:00080000:0.0:1783349902.093467:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783349902.098832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349902.098990:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642654080 00000100:00100000:1.0:1783349902.098998:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642654080 00000100:00100000:1.0:1783349902.099088:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 111 00000100:00100000:1.0:1783349902.099098:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+49:11336:x1869977642654080:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783349902.099121:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349902.099175:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2864 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfcf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.099245:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2864 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfcf expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.099258:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2864 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfcf expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.099273:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349902.099275:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783349902.099278:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c000, rc 0) 00000100:00100000:1.0:1783349902.099339:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+50:11336:x1869977642654080:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 241us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349902.099345:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 111 00000100:00100000:2.0:1783349902.104432:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349902.104739:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642654336 00000100:00100000:3.0:1783349902.104761:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642654336 00000100:00100000:3.0:1783349902.104929:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:3.0:1783349902.104940:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+50:11336:x1869977642654336:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1783349902.105227:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+51:11336:x1869977642654336:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 289us (804us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1783349902.105235:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:3.0:1783349902.171263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349902.171416:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642654464 00000100:00100000:2.0:1783349902.171426:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642654464 00000100:00100000:2.0:1783349902.171509:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 112 00000100:00100000:2.0:1783349902.171518:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+51:11346:x1869977642654464:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:2.0:1783349902.171647:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e286b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171671:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e286b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171682:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e286b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171702:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2872 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171709:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171714:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171891:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171901:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171908:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349902.171951:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171964:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e286b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171970:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e286b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171977:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e286b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171983:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349902.171986:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e286b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.171993:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e286b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172005:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:2.0:1783349902.172008:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349902.172012:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e286b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172024:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e286b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172038:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172044:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2872 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172050:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2872 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172055:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349902.172058:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2872 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172083:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2872 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172100:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea2424c5600) 00010000:00010000:2.0:1783349902.172102:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349902.172105:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2872 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172111:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2872 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172129:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172290:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172315:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172321:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349902.172324:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172331:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172352:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:2.0:1783349902.172355:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349902.172359:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.172365:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2879 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349902.172479:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+51:11346:x1869977642654464:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 951us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349902.172487:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 112 00000100:00100000:2.0:1783349902.199078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.199217:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642654720 00000100:00100000:0.0:1783349902.199228:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642654720 00000100:00100000:0.0:1783349902.199380:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 113 00000100:00100000:0.0:1783349902.199390:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+51:11349:x1869977642654720:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349902.199470:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349902.199498:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2880 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfd6 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.199608:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2887 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.199632:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2887 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.199645:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2887 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.199668:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e288e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.199677:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e288e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.199684:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e288e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200450:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200465:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200474:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349902.200484:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783349902.200625:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2887 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200633:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2887 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200640:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2887 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200660:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349902.200664:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2887 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200671:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2887 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200700:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:0.0:1783349902.200703:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349902.200708:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2887 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200714:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2887 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200728:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e288e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200737:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e288e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200742:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e288e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200747:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349902.200755:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e288e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200762:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e288e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200769:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea2424c5600) 00010000:00010000:0.0:1783349902.200771:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349902.200774:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e288e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200779:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e288e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200816:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2880 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfd6 expref: 54 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200827:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfd6 expref: 53 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.200833:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:0.0:1783349902.200835:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349902.200837:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364ae00, rc 0) 00000100:00100000:0.0:1783349902.202232:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+53:11349:x1869977642654720:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 2529us (2849us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1783349902.202252:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 113 00000100:00100000:0.0:1783349902.207954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349902.208066:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642654848 00000100:00100000:1.0:1783349902.208076:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642654848 00000100:00100000:1.0:1783349902.208361:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 114 00000100:00100000:1.0:1783349902.208384:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+53:11349:x1869977642654848:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:1.0:1783349902.208479:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.208496:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.208523:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.208593:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.208649:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.208656:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.208663:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349902.208667:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.208685:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.208698:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349902.208701:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349902.208706:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.208713:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349902.208851:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+53:11349:x1869977642654848:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 471us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349902.209660:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 114 00000100:00100000:3.0:1783349902.212885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349902.213809:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642655104 00000100:00100000:2.0:1783349902.213820:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642655104 00000100:00100000:2.0:1783349902.213950:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:2.0:1783349902.213961:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+53:11349:x1869977642655104:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349902.214271:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+54:11349:x1869977642655104:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 311us (1393us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1783349902.214306:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:2.0:1783349902.255304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.255375:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642655360 00000100:00100000:0.0:1783349902.255384:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642655360 00000100:00100000:0.0:1783349902.255435:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:0.0:1783349902.255457:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+54:11359:x1869977642655360:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349902.255479:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349902.255482:0:12147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783349902.255506:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2825 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfba expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.255524:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:0.0:1783349902.255528:0:12147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349902.255559:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e28aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfdd expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.255654:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.255666:0:12147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfd6 expref: 54 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.255674:0:12147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.255702:0:12147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfd6 expref: 54 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.255714:0:12147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfd6 expref: 54 pid: 8582 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349902.255727:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659497728:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349902.255823:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3446b4540 going to sleep for 11 seconds 00000100:00100000:3.0:1783349902.260967:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.261052:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659497728:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349902.261079:0:12147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349902.261203:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642655488 00000100:00100000:1.0:1783349902.261211:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642655488 00010000:00010000:1.0:1783349902.261246:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfd6 expref: 55 pid: 8582 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349902.261286:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:1.0:1783349902.261310:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+55:2400:x1869977642655488:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349902.261325:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349902.261332:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfd6 expref: 55 pid: 8582 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.261345:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfd6 expref: 55 pid: 8582 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.261367:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2895 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfd6 expref: 55 pid: 8582 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.261382:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349902.261386:0:7459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.261395:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.261403:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.261430:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349902.261478:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+54:2400:x1869977642655488:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 169us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349902.261486:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 70 00010000:00010000:0.0:1783349902.261833:0:12147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.261843:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349902.261862:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783349902.261986:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e28aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfdd expref: 55 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.262002:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfdd expref: 54 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.262010:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:0.0:1783349902.262013:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783349902.262016:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a200, rc 0) 00000100:00100000:0.0:1783349902.262055:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+54:11359:x1869977642655360:12345-192.168.203.50@tcp:101:bash.0 Request processed in 6600us (6760us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1783349902.262064:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:3.0:1783349902.264182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.264216:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642655616 00000100:00100000:0.0:1783349902.264226:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642655616 00000100:00100000:0.0:1783349902.264278:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:0.0:1783349902.264288:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+54:11359:x1869977642655616:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349902.264310:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349902.264342:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e28bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfe4 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.264374:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.264388:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.264399:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.264500:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e28bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfe4 expref: 56 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.264517:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfe4 expref: 55 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.264525:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:0.0:1783349902.264528:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349902.264531:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a800, rc 0) 00000100:00100000:0.0:1783349902.264598:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+55:11359:x1869977642655616:12345-192.168.203.50@tcp:101:bash.0 Request processed in 312us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349902.264605:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:3.0:1783349902.266817:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349902.267098:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642655872 00000100:00100000:1.0:1783349902.267108:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642655872 00000100:00100000:1.0:1783349902.267174:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 117 00000100:00100000:1.0:1783349902.267185:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+55:11359:x1869977642655872:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:1.0:1783349902.267395:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.267411:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.267421:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783349902.267458:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1783349902.267476:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fcefd203 reply state 000000008b8c728e transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.267488:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.267495:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349902.267498:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349902.267501:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349902.267581:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+58:11359:x1869977642655872:12345-192.168.203.50@tcp:36:bash.0 Request processed in 398us (770us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1783349902.267589:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 117 00000020:00080000:1.0:1783349902.267593:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783349902.269301:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.269355:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642656000 00000100:00100000:0.0:1783349902.269362:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642656000 00000100:00100000:0.0:1783349902.269404:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 118 00000100:00100000:0.0:1783349902.269413:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+58:11359:x1869977642656000:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349902.269428:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349902.269452:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e28d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decfeb expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.269517:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.269539:0:12147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfdd expref: 59 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.269558:0:12147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.269587:0:12147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfdd expref: 59 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.269599:0:12147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfdd expref: 59 pid: 12147 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349902.269612:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659497856:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349902.269684:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3446b4540 going to sleep for 11 seconds 00000100:00100000:3.0:1783349902.274305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.274662:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659497856:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349902.274689:0:12147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349902.274895:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642656128 00000100:00100000:2.0:1783349902.274903:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642656128 00010000:00010000:2.0:1783349902.274937:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfdd expref: 60 pid: 12147 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349902.275041:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:2.0:1783349902.275051:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+60:2400:x1869977642656128:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349902.275065:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349902.275072:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfdd expref: 60 pid: 12147 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.275084:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfdd expref: 60 pid: 12147 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.275103:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e28b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfdd expref: 60 pid: 12147 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.275117:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:2.0:1783349902.275121:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.275131:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.275187:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349902.275207:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349902.275310:0:12147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.275317:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349902.275372:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783349902.275376:0:12147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783349902.275392:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.275418:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e28d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfeb expref: 60 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.275431:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfeb expref: 59 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.275439:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:0.0:1783349902.275441:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349902.275444:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a400, rc 0) 00000100:00100000:2.0:1783349902.275481:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+59:2400:x1869977642656128:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 431us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349902.275489:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:0.0:1783349902.275628:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+58:11359:x1869977642656000:12345-192.168.203.50@tcp:101:bash.0 Request processed in 6215us (6331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349902.275635:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 118 00000100:00100000:2.0:1783349902.278709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.278898:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642656384 00000100:00100000:0.0:1783349902.278908:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642656384 00000100:00100000:0.0:1783349902.278986:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:0.0:1783349902.278995:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+58:11359:x1869977642656384:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:0.0:1783349902.279199:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+59:11359:x1869977642656384:12345-192.168.203.50@tcp:35:bash.0 Request processed in 205us (498us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1783349902.279206:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:3.0:1783349902.312269:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.312367:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642656512 00000100:00100000:0.0:1783349902.312375:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642656512 00000100:00100000:0.0:1783349902.312483:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 119 00000100:00100000:0.0:1783349902.312493:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+59:11365:x1869977642656512:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349902.312515:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349902.312532:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e28e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decff2 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.312603:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e28e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.312617:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e28e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.312628:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e28e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349902.312669:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783349902.312672:0:8582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783349902.312688:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e28e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.312709:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e28e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decff2 expref: 61 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.312725:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e28e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decff2 expref: 60 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.312735:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:0.0:1783349902.312737:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349902.312740:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a000, rc 0) 00000100:00100000:0.0:1783349902.312796:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+60:11365:x1869977642656512:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 304us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349902.312808:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 119 00000100:00100000:3.0:1783349902.315111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349902.315172:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642656640 00000100:00100000:1.0:1783349902.315179:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642656640 00000100:00100000:1.0:1783349902.315219:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:1.0:1783349902.315226:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+60:11365:x1869977642656640:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783349902.315241:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349902.315255:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e28f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5decff9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315318:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e28f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315329:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e28f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315336:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e28f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315342:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e28fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315347:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e28fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315354:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e28fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315405:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2905 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315411:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315415:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349902.315442:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783349902.315445:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783349902.315458:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315473:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315478:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e28f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315483:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e28f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315487:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e28f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315491:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ce00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349902.315494:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e28f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315498:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e28f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315505:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349902.315507:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349902.315510:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e28f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315513:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e28f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315522:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e28fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315525:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e28fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315531:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e28fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315535:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349902.315536:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e28fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315555:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e28fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315562:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea2424c5600) 00010000:00010000:1.0:1783349902.315564:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349902.315566:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e28fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315569:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e28fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315586:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e28f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decff9 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315602:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2905 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decff9 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.315609:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349902.315611:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349902.315614:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8de00, rc 0) 00000100:00100000:1.0:1783349902.315663:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+61:11365:x1869977642656640:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 436us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349902.315679:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:3.0:1783349902.317600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349902.317627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349902.317671:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642657024 00000100:00100000:1.0:1783349902.317679:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642657024 00000100:00100000:0.0:1783349902.317680:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642656896 00000100:00100000:0.0:1783349902.317687:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642656896 00000100:00100000:1.0:1783349902.317727:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:1.0:1783349902.317738:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+62:2399:x1869977642657024:12345-192.168.203.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783349902.317749:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 121 00010000:00010000:1.0:1783349902.317754:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783349902.317762:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+62:11365:x1869977642656896:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783349902.317776:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2905 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decff9 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.317783:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349902.317794:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:0.0:1783349902.317798:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e290c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded000 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.317810:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349902.317851:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+62:2399:x1869977642657024:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 117us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349902.317856:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00010000:00010000:0.0:1783349902.317887:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.317907:0:12147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfeb expref: 61 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.317916:0:12147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.317948:0:12147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfeb expref: 61 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.317961:0:12147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfeb expref: 61 pid: 12147 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349902.317975:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659497984:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349902.318049:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3462683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349902.319179:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659497984:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349902.319212:0:12147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349902.319537:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349902.319581:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642657152 00000100:00100000:1.0:1783349902.319586:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642657152 00010000:00010000:1.0:1783349902.319605:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfeb expref: 62 pid: 12147 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349902.319627:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:1.0:1783349902.319632:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+62:2399:x1869977642657152:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349902.319641:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349902.319645:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfeb expref: 62 pid: 12147 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.319653:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfeb expref: 62 pid: 12147 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.319675:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e28db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfeb expref: 62 pid: 12147 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.319686:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349902.319690:0:7459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.319698:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.319705:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349902.319725:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349902.319743:0:12147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.319750:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349902.319760:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+61:2399:x1869977642657152:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 125us (223us total) trans 0 rc 0/0 00000004:00200000:0.0:1783349902.319762:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00100000:1.0:1783349902.319771:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 72 00010000:00010000:0.0:1783349902.319853:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e290c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded000 expref: 62 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.319862:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded000 expref: 61 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.319867:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:0.0:1783349902.319869:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783349902.319871:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364aa00, rc 0) 00000100:00100000:0.0:1783349902.319900:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+61:11365:x1869977642656896:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 2144us (2305us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1783349902.319905:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:2.0:1783349902.321527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349902.321588:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642657408 00000100:00100000:3.0:1783349902.321596:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642657408 00000100:00100000:3.0:1783349902.321634:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:3.0:1783349902.321640:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+61:11365:x1869977642657408:12345-192.168.203.50@tcp:103:lfs.0 00010000:00010000:3.0:1783349902.321649:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349902.321663:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2864 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfcf expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.321675:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:3.0:1783349902.321678:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349902.321717:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+60:11365:x1869977642657408:12345-192.168.203.50@tcp:103:lfs.0 Request processed in 77us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349902.321722:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:3.0:1783349902.322746:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349902.322850:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642657536 00000100:00100000:0.0:1783349902.322856:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642657536 00000100:00100000:0.0:1783349902.322891:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:0.0:1783349902.322898:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+60:11365:x1869977642657536:12345-192.168.203.50@tcp:58:lfs.0 00010000:00010000:0.0:1783349902.322990:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.323021:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.323031:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783349902.323111:0:8582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1783349902.323207:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+60:11365:x1869977642657536:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 308us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349902.323214:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:2.0:1783349902.325193:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349902.325224:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642657664 00000100:00100000:1.0:1783349902.325234:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642657664 00000100:00100000:3.0:1783349902.325301:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:3.0:1783349902.325314:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+60:11365:x1869977642657664:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349902.325330:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349902.325346:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2928 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded007 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.325392:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.325403:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2928 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded007 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.325419:0:6518:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.325431:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2928 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded007 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.325443:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:3.0:1783349902.325446:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349902.325450:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2928 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded007 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349902.325457:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030c00, rc 0) 00000100:00100000:3.0:1783349902.325515:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+61:11365:x1869977642657664:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 205us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349902.325523:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 123 00010000:00010000:3.0:1783349902.980351:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783349903.172556:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349903.172569:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783349903.172596:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1783349903.172606:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783349903.172764:0:13790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659498112:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783349903.172992:0:13790:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3446b4540 going to sleep for 11 seconds 00000100:00100000:2.0:1783349903.183623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.183696:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642657792 00000100:00100000:1.0:1783349903.183713:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642657792 00000100:00100000:1.0:1783349903.183796:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 124 00000100:00100000:1.0:1783349903.183806:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+62:11366:x1869977642657792:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783349903.183836:0:12147:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783349903.183947:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+62:11366:x1869977642657792:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 142us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349903.183955:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 124 00000100:00080000:3.0:1783349903.184551:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349903.187236:0:13790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370df6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659498112:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783349903.191879:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349903.191967:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642657920 00000100:00100000:0.0:1783349903.191987:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642657920 00000100:00100000:0.0:1783349903.192078:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00100000:0.0:1783349903.192089:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+61:11366:x1869977642657920:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783349903.192224:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e292f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192242:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e292f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192255:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e292f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192327:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2936 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192336:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2936 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192356:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2936 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192391:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192401:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192419:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349903.192493:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783349903.192498:0:8582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783349903.192513:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192524:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e292f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192530:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e292f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192546:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e292f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192562:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349903.192567:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e292f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192575:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e292f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192587:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:0.0:1783349903.192590:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349903.192595:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e292f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192601:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e292f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192617:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2936 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192623:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2936 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192629:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2936 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192634:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349903.192638:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2936 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192643:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2936 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192672:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8ea343b1ed00) 00010000:00010000:0.0:1783349903.192674:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349903.192677:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2936 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192683:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2936 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192696:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192702:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192707:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192711:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349903.192714:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192719:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192726:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:0.0:1783349903.192728:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349903.192731:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.192736:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e293d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.192882:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+61:11366:x1869977642657920:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 782us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349903.192891:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00100000:2.0:1783349903.198712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.198773:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642658176 00000100:00100000:3.0:1783349903.198783:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642658176 00000100:00100000:3.0:1783349903.198837:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:3.0:1783349903.198848:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+61:11366:x1869977642658176:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349903.198867:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349903.198885:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2944 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded00e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.198983:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e294b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.198997:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e294b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.199007:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e294b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349903.199015:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783349903.199078:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e294b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.199085:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e294b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.199091:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e294b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.199121:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349903.199125:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e294b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.199131:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e294b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.199174:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:3.0:1783349903.199176:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783349903.199181:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e294b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.199187:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e294b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.199221:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2944 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded00e expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.199230:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:3.0:1783349903.199231:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783349903.199234:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2944 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded00e expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.199241:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031200, rc 0) 00000100:00100000:3.0:1783349903.199299:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+62:11366:x1869977642658176:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 453us (599us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1783349903.199305:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:2.0:1783349903.207889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.208066:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642658304 00000100:00100000:1.0:1783349903.208078:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642658304 00000100:00100000:1.0:1783349903.208174:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 127 00000100:00100000:1.0:1783349903.208184:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+62:11366:x1869977642658304:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783349903.208226:0:12147:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783349903.208364:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+62:11366:x1869977642658304:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 181us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349903.208372:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 127 00000100:00100000:0.0:1783349903.214791:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.214971:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642658560 00000100:00100000:1.0:1783349903.214985:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642658560 00000100:00100000:1.0:1783349903.215053:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 128 00000100:00100000:1.0:1783349903.215065:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+62:11366:x1869977642658560:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349903.215095:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349903.215100:0:8582:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783349903.215166:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e28e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decff2 expref: 62 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.215188:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349903.215193:0:8582:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349903.215208:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2959 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded015 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783349903.216561:0:8582:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1783349903.216757:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2960 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.216776:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2960 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.216812:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2960 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.216889:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2959 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded015 expref: 64 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.216916:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2960 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded015 expref: 63 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.216927:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2427f4400) 00010000:00010000:1.0:1783349903.216931:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349903.216934:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c600, rc 0) 00000100:00100000:1.0:1783349903.217040:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+63:11366:x1869977642658560:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 1977us (2263us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1783349903.217052:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 128 00000100:00100000:2.0:1783349903.221034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.221128:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642658816 00000100:00100000:3.0:1783349903.221181:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642658816 00000100:00100000:3.0:1783349903.221254:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 129 00000100:00100000:3.0:1783349903.221268:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+63:11366:x1869977642658816:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783349903.221345:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349903.221381:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2960 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded015 expref: 63 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.221610:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2427f4400) 00010000:00010000:3.0:1783349903.221629:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349903.221730:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e296e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221747:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e296e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221817:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e296e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221874:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2975 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xfbb87098 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221883:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2975 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfbb87098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221899:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2975 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfbb87098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221949:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e296e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221956:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e296e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221964:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e296e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221970:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349903.221974:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e296e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221982:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e296e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.221990:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:2.0:1783349903.221993:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349903.221997:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e296e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.222004:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e296e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.222013:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2975 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfbb87098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.222020:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2975 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfbb87098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.222031:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2975 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfbb87098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.222036:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349903.222039:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2975 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfbb87098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.222045:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2975 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfbb87098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.222052:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xfbb87098 (ffff8ea2424c5900) 00010000:00010000:2.0:1783349903.222055:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349903.222058:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2975 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfbb87098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.222064:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2975 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfbb87098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349903.222652:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+62:11366:x1869977642658816:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 1382us (1622us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783349903.222664:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 129 00000100:00100000:0.0:1783349903.227541:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349903.227695:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642658944 00000100:00100000:2.0:1783349903.227707:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642658944 00000100:00100000:2.0:1783349903.227855:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:2.0:1783349903.227866:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+62:11366:x1869977642658944:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349903.227886:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349903.227908:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e297c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded01c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.227969:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.227984:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.227997:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.228102:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e297c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded01c expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.228122:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded01c expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.228131:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:2.0:1783349903.228250:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783349903.228255:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7000, rc 0) 00000100:00100000:2.0:1783349903.228360:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+63:11366:x1869977642658944:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 496us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349903.228368:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:0.0:1783349903.234385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.235619:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642659200 00000100:00100000:1.0:1783349903.235631:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642659200 00000100:00100000:1.0:1783349903.235696:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 131 00000100:00100000:1.0:1783349903.235706:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+63:11366:x1869977642659200:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783349903.235804:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.235822:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.235835:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349903.235991:0:8582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1783349903.236000:0:8582:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344030863194ns, next at 345030861229ns, rc = 0 00000004:00010000:1.0:1783349903.236043:0:8582:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000745299c1 reply state 00000000f2893d1a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.236057:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.236065:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:1.0:1783349903.236068:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783349903.236072:0:8582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783349903.236346:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659498368:0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.236513:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659498240:0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.236685:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+65:11366:x1869977642659200:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 979us (2310us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1783349903.236693:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 131 00000100:00100000:3.0:1783349903.236873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349903.237007:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659498880:0@lo:400:kworker.0 00000100:00100000:3.0:1783349903.237029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349903.237066:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349903.237089:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659498752:0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237112:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349903.237130:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659499264:0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349903.237193:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659499776:0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237210:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349903.237228:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1783349903.237233:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659498624:0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237257:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659498240 00000100:00100000:2.0:1783349903.237261:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659498240 00000100:00100000:2.0:1783349903.237289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1783349903.237296:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659498240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237337:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659498240:12345-0@lo:400:kworker.0 Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349903.237343:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1783349903.237376:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659499264 00000100:00100000:2.0:1783349903.237380:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659499264 00000100:00100000:2.0:1783349903.237405:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659499776 00000100:00100000:2.0:1783349903.237408:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659499776 00000100:00100000:2.0:1783349903.237434:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783349903.237440:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3649:x1869977659499264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237469:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3649:x1869977659499264:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349903.237475:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783349903.237486:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783349903.237492:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659499776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237516:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659499776:12345-0@lo:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349903.237522:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783349903.237571:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659498496:0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349903.237619:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659499008:0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237643:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659498752 00000100:00100000:2.0:1783349903.237646:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659498752 00000100:00100000:2.0:1783349903.237668:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659498496 00000100:00100000:2.0:1783349903.237671:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659498496 00000100:00100000:2.0:1783349903.237685:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783349903.237690:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659498752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237723:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659498752:12345-0@lo:400:kworker.0 Request processed in 32us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349903.237729:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783349903.237739:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783349903.237744:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659498496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349903.237767:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659498496:12345-0@lo:400:kworker.0 Request processed in 24us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349903.237774:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1783349903.237796:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349903.237799:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349903.238294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349903.238324:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659499392:0@lo:400:kworker.0 00000100:00100000:0.0:1783349903.238473:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659498368 00000100:00100000:0.0:1783349903.238477:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659498368 00000100:00100000:0.0:1783349903.238503:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659498880 00000100:00100000:0.0:1783349903.238506:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659498880 00000100:00100000:0.0:1783349903.238542:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783349903.238550:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659498368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349903.238586:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659498368:12345-0@lo:400:kworker.0 Request processed in 37us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349903.238592:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783349903.238606:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1783349903.238613:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659498880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349903.238639:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659498880:12345-0@lo:400:kworker.0 Request processed in 27us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349903.238644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783349903.238765:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659499520:0@lo:400:kworker.0 00000100:00100000:3.0:1783349903.238787:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349903.238801:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659500032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349903.238819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349903.238850:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659498496:0@lo:400:kworker.0 00000100:00100000:3.0:1783349903.238861:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349903.238867:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659499904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349903.238888:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349903.238914:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659500032 00000100:00100000:3.0:1783349903.238917:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659500032 00000100:00100000:3.0:1783349903.238942:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783349903.238948:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659500032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783349903.238974:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349903.239004:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659500032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.239010:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783349903.239038:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659500032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349903.239053:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659499904 00000100:00100000:3.0:1783349903.239055:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659499904 00000100:00100000:3.0:1783349903.239072:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783349903.239077:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659499904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783349903.239096:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783349903.239122:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659499904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.239128:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783349903.239169:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659499904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349903.239187:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659499008 00000100:00100000:3.0:1783349903.239190:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659499008 00000100:00100000:3.0:1783349903.239209:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659499520 00000100:00100000:3.0:1783349903.239211:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659499520 00000100:00100000:3.0:1783349903.239226:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1783349903.239231:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659499008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349903.239259:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659499008:12345-0@lo:400:kworker.0 Request processed in 27us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.239265:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1783349903.239274:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1783349903.239279:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659499520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349903.239309:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659499520:12345-0@lo:400:kworker.0 Request processed in 30us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.239315:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00010000:00080000:3.0:1783349903.239336:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2439b6680 x1869977659499008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349903.239348:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659499008:0@lo:400:kworker.0 00010000:00080000:3.0:1783349903.239357:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2439b4e00 x1869977659499520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349903.239365:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659499520:0@lo:400:kworker.0 00000100:00080000:3.0:1783349903.239390:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349903.239393:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349903.239395:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349903.239406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349903.239429:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659498368:0@lo:400:kworker.0 00000100:00100000:3.0:1783349903.239441:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659498880:0@lo:400:kworker.0 00000100:00100000:3.0:1783349903.239458:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659499392 00000100:00100000:3.0:1783349903.239461:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659499392 00000100:00100000:3.0:1783349903.239485:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1783349903.239491:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659499392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349903.239521:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659499392:12345-0@lo:400:kworker.0 Request processed in 30us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.239527:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1783349903.239549:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349903.239563:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659499392:0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.239636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349903.239660:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659499136:0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.239683:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349903.239697:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659499648:0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.239714:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349903.239726:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659500160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349903.239742:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349903.239762:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659498240:0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.239771:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659498752:0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.239781:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659499264:0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.239791:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659499776:0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.239824:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659500160 00000100:00100000:1.0:1783349903.239827:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659500160 00000100:00100000:1.0:1783349903.239847:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783349903.239853:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659500160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349903.239863:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349903.239890:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659500160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349903.239895:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783349903.239920:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659500160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349903.239934:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659499136 00000100:00100000:1.0:1783349903.239936:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659499136 00000100:00100000:1.0:1783349903.239959:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659499648 00000100:00100000:1.0:1783349903.239961:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659499648 00000100:00100000:1.0:1783349903.239975:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783349903.239980:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659499136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.240010:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659499136:12345-0@lo:400:kworker.0 Request processed in 30us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349903.240016:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783349903.240027:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783349903.240033:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659499648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.240056:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659499648:12345-0@lo:400:kworker.0 Request processed in 23us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349903.240061:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1783349903.240071:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349903.240084:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659499136:0@lo:400:kworker.0 00000100:00100000:1.0:1783349903.240091:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659499648:0@lo:400:kworker.0 00000100:00100000:3.0:1783349903.240171:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659498624 00000100:00100000:3.0:1783349903.240176:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659498624 00000100:00100000:3.0:1783349903.240208:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1783349903.240214:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659498624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349903.240243:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659498624:12345-0@lo:400:kworker.0 Request processed in 30us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.240248:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1783349903.240305:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659498624:0@lo:400:kworker.0 00000100:00100000:0.0:1783349903.259900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.262163:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642659328 00000100:00100000:3.0:1783349903.262179:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642659328 00000100:00100000:3.0:1783349903.262255:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 132 00000100:00100000:3.0:1783349903.262266:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+65:11366:x1869977642659328:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349903.262299:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349903.262320:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2991 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded023 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.262375:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2991 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded023 expref: 66 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.262390:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2991 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded023 expref: 66 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.262405:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:3.0:1783349903.262408:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349903.262412:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031200, rc 0) 00000100:00100000:3.0:1783349903.262464:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+66:11366:x1869977642659328:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 201us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.262471:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 132 00000100:00100000:1.0:1783349903.264990:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349903.267711:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642659456 00000100:00100000:2.0:1783349903.267726:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642659456 00000100:00080000:1.0:1783349903.267816:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349903.267822:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:2.0:1783349903.267833:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642659456:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783349903.268053:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642659456:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 221us (3069us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783349903.268077:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:0.0:1783349903.278950:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349903.279035:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642659712 00000100:00100000:2.0:1783349903.279044:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642659712 00000100:00100000:2.0:1783349903.279103:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:2.0:1783349903.279112:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+66:11366:x1869977642659712:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783349903.279335:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+67:11366:x1869977642659712:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 224us (394us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1783349903.279344:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:0.0:1783349903.281065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.281303:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642659968 00000100:00100000:1.0:1783349903.281311:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642659968 00000100:00100000:1.0:1783349903.281364:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:1.0:1783349903.281374:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+67:11366:x1869977642659968:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783349903.281471:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+67:11366:x1869977642659968:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 99us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349903.281479:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:1.0:1783349903.284446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349903.284557:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642660096 00000100:00100000:2.0:1783349903.284567:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642660096 00000100:00100000:2.0:1783349903.284613:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 134 00000100:00100000:2.0:1783349903.284622:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+67:11366:x1869977642660096:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349903.284642:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349903.284661:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2998 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded02a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.284738:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e299f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.284752:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e299f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.284772:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e299f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349903.284818:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349903.284838:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e299f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.284880:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2998 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded02a expref: 69 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.284900:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e299f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded02a expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.284909:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:2.0:1783349903.284912:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783349903.284916:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7400, rc 0) 00000100:00100000:2.0:1783349903.284976:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+68:11366:x1869977642660096:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 355us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349903.284983:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 134 00000100:00100000:2.0:1783349903.290986:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.291071:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642660224 00000100:00100000:1.0:1783349903.291080:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642660224 00000100:00100000:2.0:1783349903.291384:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:2.0:1783349903.291395:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+9:2400:x1869977642660224:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349903.291412:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349903.291430:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e29a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded031 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349903.291452:0:13811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc28e, blocks: 0x0 00010000:00010000:2.0:1783349903.291468:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1783349903.291472:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349903.291480:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e29a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded031 expref: 10 pid: 13811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.291514:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e29a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded031 expref: 10 pid: 13811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.291531:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6600, rc 0) 00000100:00100000:2.0:1783349903.291851:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+10:2400:x1869977642660224:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 457us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349903.291859:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:0.0:1783349903.293937:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.294020:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642660480 00000100:00100000:1.0:1783349903.294028:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642660480 00000100:00100000:1.0:1783349903.294080:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 135 00000100:00100000:1.0:1783349903.294088:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+68:11366:x1869977642660480:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783349903.294208:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+68:11366:x1869977642660480:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 120us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349903.294214:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 135 00000100:00100000:0.0:1783349903.296832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.297042:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642660608 00000100:00100000:1.0:1783349903.297052:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642660608 00000100:00100000:1.0:1783349903.297180:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:1.0:1783349903.297190:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+10:11366:x1869977642660608:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349903.297206:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349903.297233:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded038 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.297264:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e29a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded031 expref: 11 pid: 13811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.297273:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349903.297278:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349903.297283:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.297317:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e29a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded031 expref: 11 pid: 13811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.297330:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e29a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded031 expref: 11 pid: 13811 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349903.297344:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1869977659500288:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349903.297426:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a480 going to sleep for 11 seconds 00000100:00100000:2.0:1783349903.299643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.299720:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1869977659500288:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349903.299753:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.299775:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8ce00, rc 0) 00000100:00100000:0.0:1783349903.299798:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642660736 00000100:00100000:0.0:1783349903.299820:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642660736 00000100:00100000:1.0:1783349903.299838:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+12:11366:x1869977642660608:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 2649us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349903.299859:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00010000:00010000:0.0:1783349903.300069:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e29a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded031 expref: 12 pid: 13811 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.300106:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:0.0:1783349903.300115:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350948850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+11:2399:x1869977642660736:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349903.300131:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349903.300352:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e29a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded031 expref: 11 pid: 13811 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.300368:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e29a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded031 expref: 11 pid: 13811 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.300393:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e29a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded031 expref: 11 pid: 13811 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.300404:0:13183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349903.300408:0:13183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349903.300416:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.300425:0:13183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.300455:0:13183:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.300480:0:13183:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13183:1869977659500416:192.168.203.50@tcp:105: 00000100:00100000:0.0:1783349903.300581:0:13183:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3446b4540 going to sleep for 11 seconds 00000100:00100000:2.0:1783349903.304046:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349903.304068:0:13183:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13183:1869977659500416:192.168.203.50@tcp:105: 00010000:00010000:0.0:1783349903.304101:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349903.304164:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350948850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+10:2399:x1869977642660736:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 4047us (4533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349903.304174:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:1.0:1783349903.304327:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642660864 00000100:00100000:1.0:1783349903.304334:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642660864 00002000:00100000:1.0:1783349903.304377:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ea2444ed880 x1869977642660864/t0(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:654/0 lens 504/0 e 0 to 0 dl 1783349914 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349903.304388:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea2444ed880 with x1869977642660864 ext(0->12) 00002000:00010000:1.0:1783349903.304393:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea2444ed880 00000100:00100000:1.0:1783349903.304415:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:1.0:1783349903.304423:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689af055-7605-419d-81ba-26cff8cb556b+10:2400:x1869977642660864:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783349903.305577:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689af055-7605-419d-81ba-26cff8cb556b+12:2400:x1869977642660864:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 Request processed in 1149us (1537us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783349903.305587:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00002000:00100000:1.0:1783349903.305596:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ea2444ed880 x1869977642660864/t4294967309(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:654/0 lens 504/448 e 0 to 0 dl 1783349914 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349903.305606:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea2444ed880 with x1869977642660864 ext(0->12) 00002000:00010000:1.0:1783349903.305611:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea2444ed880 00000100:00100000:2.0:1783349903.309468:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349903.309577:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642660992 00000100:00100000:0.0:1783349903.309586:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642660992 00000100:00100000:0.0:1783349903.309668:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 136 00000100:00100000:0.0:1783349903.309689:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+68:11366:x1869977642660992:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783349903.311948:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1783349903.311964:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1783349903.312035:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1783349903.312052:0:6496:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ea3446b4b40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1783349903.312057:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36d856f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ea3446b49c0 00000020:00080000:1.0:1783349903.312061:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36d856100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ea34b46be00 00000004:00080000:1.0:1783349903.312087:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1783349903.312166:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1783349903.312186:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349903.312207:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659500544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783349903.312282:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349903.312335:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659500800:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1783349903.312339:0:6496:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ea349a5af00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1783349903.312344:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea342d12500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ea349a5a900 00000020:00080000:1.0:1783349903.312347:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea342d12800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ea243897a00 00000100:00100000:3.0:1783349903.312355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783349903.312366:0:6496:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1783349903.312374:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349903.312380:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659500672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783349903.312393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1783349903.312407:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1783349903.312425:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659500544 00000100:00100000:0.0:1783349903.312433:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659500544 00000020:00080000:3.0:1783349903.312454:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1783349903.312469:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659500800 00000100:00100000:3.0:1783349903.312473:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659500800 00000100:00100000:0.0:1783349903.312482:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659500672 00000100:00100000:0.0:1783349903.312486:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659500672 00000100:00100000:3.0:1783349903.312501:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783349903.312509:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1869977659500544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783349903.312552:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00000100:00100000:0.0:1783349903.312561:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349903.312571:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1869977659500800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783349903.312594:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a4bc28d, atime: 0x6a4bc28d, ctime: 0x6a4bc28d, blocks: 0x8 00010000:00010000:3.0:1783349903.312604:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e29b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.312618:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1783349903.312621:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349903.312625:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e29b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.312637:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e29b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.312654:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e29b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.312660:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e29b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.312672:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783349903.312688:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783349903.312693:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783349902 00002000:00010000:0.0:1783349903.312696:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783349903.312699:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1783349902 -> 1783349902 00002000:00010000:0.0:1783349903.312701:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1783349903.312747:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1869977659500800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (390us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1783349903.312778:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783349903.312779:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3648:x1869977659500544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 267us (493us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783349903.312785:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783349903.312804:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783349903.312811:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1869977659500672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783349903.312820:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1783349903.312831:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.312844:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e2768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf90 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783349903.312847:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea2438baa00/2, rc 0, transno 4294967310 00010000:00010000:3.0:1783349903.312850:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1783349903.312854:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00000100:00100000:0.0:1783349903.312856:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659500800:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1783349903.312858:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.312882:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e2768 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf90 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.312900:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e2768 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf90 expref: 11 pid: 8431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.312905:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349903.312911:0:8433:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1869977659500928:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783349903.312922:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.312931:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.312938:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349903.312944:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.312952:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.312967:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ea370dcee00) 00000100:00100000:3.0:1783349903.312970:0:8433:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963b40 going to sleep for 11 seconds 00010000:00010000:2.0:1783349903.312979:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349903.312983:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349903.312985:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.312991:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e29b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.312994:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e26b2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.313012:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031e00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349903.313018:0:7458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e29b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.313028:0:7458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e29b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313031:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313044:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.313050:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e29b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313052:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.313071:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a95587b/0xd05e6ae1590e29b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313071:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364bc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349903.313077:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313085:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.313090:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349903.313093:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349903.313096:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ea343b1e200) 00010000:00010000:2.0:1783349903.313102:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349903.313103:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349903.313108:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313115:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e275a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783349903.313123:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea2439b5180/2, rc 0, transno 4294967305 00000100:00100000:3.0:1783349903.313128:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659500544:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783349903.313132:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313187:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313195:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313201:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349903.313205:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313212:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313230:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea2424c5600) 00010000:00010000:2.0:1783349903.313233:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349903.313237:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313243:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e27d8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313260:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313267:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313274:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313280:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ca00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349903.313288:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313295:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313306:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea2424c5600) 00010000:00010000:2.0:1783349903.313308:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349903.313312:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313318:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e27fb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313342:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313348:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313355:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313360:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349903.313364:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313370:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313379:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:2.0:1783349903.313382:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349903.313390:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313396:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e28cd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313412:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313419:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313426:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313432:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8de00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349903.313436:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313442:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313452:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:2.0:1783349903.313455:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783349903.313458:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.313464:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e298a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.313650:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+16:11366:x1869977642660992:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 3961us (4188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349903.313659:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 136 00000100:00100000:3.0:1783349903.315070:0:8433:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1869977659500928:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349903.315094:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349903.315684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349903.315733:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.315834:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642661120 00000100:00100000:1.0:1783349903.315840:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642661120 00010000:00010000:1.0:1783349903.315866:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e2768 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf90 expref: 12 pid: 8431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349903.315896:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 74 00000100:00100000:0.0:1783349903.315899:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642661248 00000100:00100000:1.0:1783349903.315903:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+12:2399:x1869977642661120:12345-192.168.203.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783349903.315906:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642661248 00010000:00010000:1.0:1783349903.315916:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349903.315921:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e2768 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf90 expref: 13 pid: 8431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.315930:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e2768 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf90 expref: 13 pid: 8431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.315950:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f368c1c0/0xd05e6ae1590e2768 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf90 expref: 13 pid: 8431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.315952:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:0.0:1783349903.315965:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+12:2399:x1869977642661248:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1783349903.315966:0:7459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783349903.315981:0:7459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783349903.315986:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.316007:0:7459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.316029:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349903.316065:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+12:2399:x1869977642661120:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 163us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349903.316069:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 74 00010000:00010000:3.0:1783349903.316380:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.316393:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.316403:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.316411:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.316424:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783349903.316455:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349903.316463:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.316474:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783349903.316479:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.316489:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.316503:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.316510:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe5d5896/0xd05e6ae1590e29bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.316966:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349903.316970:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349903.316973:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349903.317249:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3647:x1869977659500672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4437us (4851us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783349903.317258:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1783349903.317308:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea2438bb100/2, rc 0, transno 4294967311 00000100:00100000:1.0:1783349903.317315:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659500672:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1783349903.317684:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1783349903.317691:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1783349903.317814:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642661248:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 1850us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349903.317823:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:2.0:1783349903.320030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.320103:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642661504 00000100:00100000:3.0:1783349903.320116:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642661504 00000100:00100000:3.0:1783349903.320384:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 137 00000100:00100000:3.0:1783349903.320395:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+16:11366:x1869977642661504:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783349903.320471:0:12147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349903.320496:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e299f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded02a expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.320518:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:3.0:1783349903.320523:0:12147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349903.320566:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.320579:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.320589:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349903.320715:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dba911b0 reply state 00000000b3306c39 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.320727:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.320734:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:3.0:1783349903.320736:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783349903.320739:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783349903.320833:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+17:11366:x1869977642661504:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 440us (812us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1783349903.320841:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 137 00000100:00100000:2.0:1783349903.324596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.324770:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642661632 00000100:00100000:1.0:1783349903.324779:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642661632 00000100:00100000:1.0:1783349903.324864:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:1.0:1783349903.324875:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+6:2400:x1869977642661632:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783349903.325032:0:13811:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783349903.325035:0:13811:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1783349902 -> 1783349901 00002000:00010000:1.0:1783349903.325038:0:13811:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783349901 00002000:00010000:1.0:1783349903.325041:0:13811:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1783349902 -> 1783349901 00002000:00010000:1.0:1783349903.325043:0:13811:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1783349903.325101:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642661632:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 228us (514us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783349903.325108:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:1.0:1783349903.327914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.328270:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642661888 00000100:00100000:3.0:1783349903.328280:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642661888 00000100:00100000:3.0:1783349903.328341:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 138 00000100:00100000:3.0:1783349903.328356:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+17:11366:x1869977642661888:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783349903.328419:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.328434:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded01c expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.328444:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.328479:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded01c expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.328494:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded01c expref: 17 pid: 6519 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349903.328508:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1869977659501056:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349903.328827:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963240 going to sleep for 11 seconds 00000100:00100000:3.0:1783349903.332837:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1869977659501056:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349903.332861:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349903.332907:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.332982:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642662016 00000100:00100000:3.0:1783349903.332990:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642662016 00010000:00010000:3.0:1783349903.333087:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded01c expref: 18 pid: 6519 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349903.333278:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00100000:3.0:1783349903.333306:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+18:2399:x1869977642662016:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349903.333325:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349903.333333:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded01c expref: 18 pid: 6519 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.333346:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded01c expref: 18 pid: 6519 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.333369:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2983 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded01c expref: 18 pid: 6519 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.333385:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:3.0:1783349903.333390:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.333402:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.333409:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.333446:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349903.333502:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+17:2399:x1869977642662016:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 199us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.333509:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 75 00010000:00010000:0.0:1783349903.333579:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.333587:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.333620:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.333627:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.333633:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.333639:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349903.333643:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.333650:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.333659:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:0.0:1783349903.333668:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783349903.333673:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.333679:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e29c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.333719:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+16:11366:x1869977642661888:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 Request processed in 5364us (5815us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783349903.333726:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 138 00000100:00100000:2.0:1783349903.335918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.335999:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642662144 00000100:00100000:3.0:1783349903.336086:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642662144 00000100:00100000:3.0:1783349903.336264:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:3.0:1783349903.336275:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+7:2401:x1869977642662144:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783349903.336333:0:9981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.336356:0:9981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.336366:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349903.336370:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349903.336375:0:9981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.336409:0:9981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.336423:0:9981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 7 pid: 8432 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349903.336438:0:9981:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9981:1869977659501184:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349903.336572:0:9981:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349903.338947:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.339043:0:9981:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9981:1869977659501184:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349903.339067:0:9981:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.339117:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642662272 00000100:00100000:0.0:1783349903.339124:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642662272 00010000:00010000:0.0:1783349903.339284:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 8 pid: 8432 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.339360:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:0.0:1783349903.339371:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+8:2400:x1869977642662272:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349903.339385:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349903.339405:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 8 pid: 8432 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.339418:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 8 pid: 8432 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.339441:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2dea44c/0xd05e6ae1590e29ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded038 expref: 8 pid: 8432 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.339458:0:13183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349903.339473:0:13183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349903.339480:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.339490:0:13183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.339527:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349903.339584:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642662272:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 215us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349903.339593:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 76 00010000:00010000:3.0:1783349903.339633:0:9981:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.339652:0:9981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.339673:0:9981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.339682:0:9981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.339690:0:9981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.339696:0:9981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349903.339700:0:9981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.339710:0:9981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.339722:0:9981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.339730:0:9981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e29d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349903.339798:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642662144:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 3525us (3888us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.339806:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:3.0:1783349903.341629:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.342267:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642662528 00000100:00100000:1.0:1783349903.342277:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642662528 00000100:00100000:1.0:1783349903.342324:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 139 00000100:00100000:1.0:1783349903.342333:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+16:11366:x1869977642662528:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783349903.342402:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.342418:0:8582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfe4 expref: 16 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.342428:0:8582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.342458:0:8582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfe4 expref: 16 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.342471:0:8582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfe4 expref: 16 pid: 8582 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349903.342486:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659501312:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349903.342586:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a480 going to sleep for 11 seconds 00000100:00100000:2.0:1783349903.345500:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.345582:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642662656 00000100:00100000:3.0:1783349903.345590:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642662656 00010000:00010000:3.0:1783349903.345622:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfe4 expref: 17 pid: 8582 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349903.345661:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 77 00000100:00100000:3.0:1783349903.345670:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+17:2399:x1869977642662656:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349903.345685:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349903.345692:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfe4 expref: 17 pid: 8582 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.345706:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfe4 expref: 17 pid: 8582 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.345727:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:3.0:1783349903.345734:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2928 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded007 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.345745:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.345753:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.345784:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.345802:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349903.345849:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+17:2399:x1869977642662656:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 179us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.345856:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 77 00010000:00010000:1.0:1783349903.347094:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e28c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decfe4 expref: 16 pid: 8582 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349903.347117:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659501312:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349903.347259:0:8582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.347284:0:8582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.347291:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.347450:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.347464:0:8582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2991 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded023 expref: 16 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.347472:0:8582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.347502:0:8582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2991 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded023 expref: 16 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.347591:0:8582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2991 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded023 expref: 16 pid: 12147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349903.347608:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659501440:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349903.347737:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349903.354861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.354967:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659501440:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349903.354996:0:8582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349903.355116:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642662784 00000100:00100000:3.0:1783349903.355124:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642662784 00010000:00010000:0.0:1783349903.355388:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2991 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded023 expref: 17 pid: 12147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.355452:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:0.0:1783349903.355463:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+17:2400:x1869977642662784:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349903.355477:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349903.355484:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2991 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded023 expref: 17 pid: 12147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.355496:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2991 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded023 expref: 17 pid: 12147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.355588:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2991 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded023 expref: 17 pid: 12147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.355607:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:0.0:1783349903.355625:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.355635:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.355643:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.355671:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349903.355742:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+16:2400:x1869977642662784:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 281us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349903.355750:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 78 00010000:00010000:2.0:1783349903.355811:0:8582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.355818:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349903.355921:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1783349903.356017:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1783349903.356046:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1783349903.356111:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8582:1869977659501568:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783349903.356198:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349903.356224:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659501568 00000100:00100000:2.0:1783349903.356228:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659501568 00000100:00100000:2.0:1783349903.356253:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783349903.356258:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8582:x1869977659501568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783349903.356312:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8582:x1869977659501568:12345-0@lo:1000:mdt00_003.0 Request processed in 54us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349903.356319:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783349903.356339:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349903.356353:0:8582:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1783349903.356357:0:8582:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1783349903.356371:0:8582:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea2438baa00, transno 4294967310 00000100:00100000:2.0:1783349903.356383:0:8582:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8ea2438bb100 x1869977659500672/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783349919 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349903.356402:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8582:1869977659501568:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1783349903.356580:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1783349903.356612:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8582:1869977659501696:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783349903.356634:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349903.356652:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349903.356788:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659501696 00000100:00100000:3.0:1783349903.356793:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659501696 00000100:00100000:3.0:1783349903.356828:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783349903.356836:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8582:x1869977659501696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783349903.356942:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8582:x1869977659501696:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (306us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1783349903.356951:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783349903.356969:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8582:1869977659501696:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1783349903.356998:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357008:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357016:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357022:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349903.357027:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357040:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357053:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:2.0:1783349903.357055:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349903.357059:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357066:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e29de lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357100:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357106:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357113:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357117:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349903.357120:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357126:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357133:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:2.0:1783349903.357683:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349903.357689:0:8582:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2928 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded007 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357702:0:8582:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2928 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded007 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357711:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2928 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded007 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349903.357738:0:8582:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2928 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded007 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349903.357770:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659501824:192.168.203.50@tcp:105: 00000100:00100000:2.0:1783349903.357838:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349903.361040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349903.361127:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659501824:192.168.203.50@tcp:105: 00010000:00010000:1.0:1783349903.361205:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361216:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2921 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361246:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e29e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361260:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e29e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361271:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e29e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361281:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e29e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361288:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e29e5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361295:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e29e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361300:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8dc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349903.361304:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e29e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361311:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e29e5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361321:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349903.361323:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349903.361334:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e29e5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361341:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e29e5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361352:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361358:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361364:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361370:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349903.361373:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361379:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361386:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349903.361388:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783349903.361391:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349903.361397:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e29d7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349903.361568:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+19:11366:x1869977642662528:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 19234us (19945us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1783349903.361578:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 139 00000020:00080000:1.0:1783349903.361589:0:8582:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783349903.361641:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349903.361646:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1783349903.362239:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642662912 00000100:00100000:3.0:1783349903.362248:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642662912 00000100:00100000:3.0:1783349903.362293:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:3.0:1783349903.362302:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+19:11365:x1869977642662912:12345-192.168.203.50@tcp:49:lfs.0 00000100:00100000:3.0:1783349903.362404:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+19:11365:x1869977642662912:12345-192.168.203.50@tcp:49:lfs.0 Request processed in 102us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.362412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 31 00000040:00080000:0.0:1783349903.362477:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1783349903.362486:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783349903.366375:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.366473:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642663168 00000100:00100000:3.0:1783349903.366482:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642663168 00000100:00100000:3.0:1783349903.366547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:3.0:1783349903.366556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fc9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+19:11366:x1869977642663168:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783349903.366892:0:6520:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783349903.366926:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1783349903.366957:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.366973:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.366984:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.366992:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.366999:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.367005:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.367061:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783349903.367180:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fc9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+21:11366:x1869977642663168:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 623us (814us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1783349903.367188:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 32 00000020:00080000:3.0:1783349903.367193:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783349903.369567:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.369722:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642663424 00000100:00100000:3.0:1783349903.369732:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642663424 00000100:00100000:3.0:1783349903.369799:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 140 00000100:00100000:3.0:1783349903.369808:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+21:11365:x1869977642663424:12345-192.168.203.50@tcp:58:lfs.0 00000040:00080000:3.0:1783349903.369962:0:12147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1783349903.370348:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+21:11365:x1869977642663424:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 539us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.370357:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 140 00010000:00010000:0.0:1783349903.370710:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349903.370719:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.370730:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783349903.370734:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.370744:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.370837:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:0.0:1783349903.370840:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783349903.370845:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.370859:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e29ec lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.370873:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349903.370875:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349903.370877:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349903.399773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349903.399871:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642663552 00000100:00100000:0.0:1783349903.399880:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642663552 00000100:00100000:0.0:1783349903.399940:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 141 00000100:00100000:0.0:1783349903.399950:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+21:11368:x1869977642663552:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349903.399975:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349903.399994:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e29f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded03f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400067:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e29fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400081:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e29fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400093:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e29fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400108:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2a01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400115:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2a01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400121:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2a01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400242:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400253:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded000 expref: 22 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400262:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400291:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded000 expref: 22 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.400304:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded000 expref: 22 pid: 12147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.400317:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1869977659501952:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349903.400399:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242708000 going to sleep for 11 seconds 00000100:00100000:1.0:1783349903.403335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349903.403399:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642663808 00000100:00100000:3.0:1783349903.403408:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642663808 00000100:00100000:3.0:1783349903.403461:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:3.0:1783349903.403472:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+23:6164:x1869977642663808:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783349903.403682:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+24:6164:x1869977642663808:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 211us (354us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1783349903.403689:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:0.0:1783349903.404257:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1869977659501952:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349903.404280:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349903.405853:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349903.405977:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642663936 00000100:00100000:0.0:1783349903.405985:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642663936 00010000:00010000:0.0:1783349903.406027:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded000 expref: 24 pid: 12147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349903.406060:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:0.0:1783349903.406075:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+24:2399:x1869977642663936:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349903.406091:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349903.406097:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded000 expref: 24 pid: 12147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.406111:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded000 expref: 24 pid: 12147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.406132:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2913 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded000 expref: 24 pid: 12147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.406321:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:0.0:1783349903.406326:0:13183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.406336:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.406344:0:13183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349903.406372:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349903.406412:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+23:2399:x1869977642663936:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 337us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349903.406420:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 79 00010000:00010000:3.0:1783349903.406472:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406480:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349903.406547:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783349903.406552:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349903.406571:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406583:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406592:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e29fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406599:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e29fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406606:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e29fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406619:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349903.406623:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e29fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406631:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e29fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406640:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:3.0:1783349903.406643:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349903.406646:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e29fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406653:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e29fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406664:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2a01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406669:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2a01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406675:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2a01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406680:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364bc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349903.406683:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2a01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406690:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2a01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406707:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ea343b1e000) 00010000:00010000:3.0:1783349903.406710:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349903.406713:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2a01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406719:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2a01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406750:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e29f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded03f expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406772:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded03f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349903.406779:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:3.0:1783349903.406782:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349903.406784:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b400, rc 0) 00000100:00100000:3.0:1783349903.406809:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+22:11368:x1869977642663552:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 6861us (7055us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349903.406817:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 141 00000040:00080000:0.0:1783349903.812992:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783349904.004597:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783349904.047342:0:14256:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349904.047351:0:14256:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349904.047381:0:14256:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783349904.047386:0:14256:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1783349904.396864:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349904.396873:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349904.396912:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783349904.396924:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349904.397054:0:13790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659502080:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783349904.397169:0:13790:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea346268540 going to sleep for 11 seconds 00000100:00100000:2.0:1783349904.410268:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349904.410600:0:13790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659502080:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783349904.411620:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642664064 00000100:00100000:1.0:1783349904.411631:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642664064 00000100:00100000:1.0:1783349904.411725:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:1.0:1783349904.411750:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+22:11381:x1869977642664064:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783349904.411806:0:8582:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783349904.412241:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+22:11381:x1869977642664064:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 484us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349904.412251:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:2.0:1783349904.420383:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349904.421207:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642664320 00000100:00100000:3.0:1783349904.421218:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642664320 00000100:00100000:3.0:1783349904.421294:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 143 00000100:00100000:3.0:1783349904.421305:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+22:11381:x1869977642664320:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349904.421325:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349904.421347:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a0f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded046 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349904.421449:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2a16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349904.421475:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349904.421489:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349904.421500:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783349904.421614:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a0f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded046 expref: 25 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349904.421631:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2a16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded046 expref: 24 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349904.421641:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:3.0:1783349904.421657:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349904.421661:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030200, rc 0) 00000100:00100000:3.0:1783349904.421733:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+24:11381:x1869977642664320:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 430us (1359us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1783349904.421741:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 143 00000100:00100000:3.0:1783349904.427671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349904.427824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349904.427959:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642664704 00000100:00100000:1.0:1783349904.427970:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642664704 00000100:00100000:1.0:1783349904.428044:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:1.0:1783349904.428055:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350948450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+24:2400:x1869977642664704:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349904.428071:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349904.428093:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2a16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded046 expref: 24 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.428114:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349904.428118:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349904.428201:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350948450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+23:2400:x1869977642664704:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 147us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349904.428209:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1783349904.430359:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642664576 00000100:00100000:0.0:1783349904.430372:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642664576 00000100:00100000:1.0:1783349904.430906:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 144 00000100:00100000:1.0:1783349904.430917:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+23:11381:x1869977642664576:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783349904.430989:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2a24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.431032:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2a24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.431044:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2a24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.431570:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2a24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.431579:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2a24 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.431587:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2a24 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.431594:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8dc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349904.431598:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2a24 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.431605:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2a24 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.431856:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349904.431859:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783349904.431864:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2a24 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.431870:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2a24 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349904.432092:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+24:11381:x1869977642664576:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 1174us (4427us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1783349904.432114:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 144 00000100:00100000:1.0:1783349904.436405:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349904.436491:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642664960 00000100:00100000:2.0:1783349904.436500:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642664960 00000100:00100000:2.0:1783349904.436570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:2.0:1783349904.436580:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+24:11381:x1869977642664960:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783349904.437131:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+25:11381:x1869977642664960:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 550us (732us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1783349904.437157:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00000040:00080000:0.0:1783349904.439029:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349904.439048:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783349904.442321:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783349904.442341:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349904.773080:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659502208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349904.773422:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659502336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349904.773461:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349904.773951:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659502336 00000100:00100000:2.0:1783349904.773959:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659502336 00000100:00100000:2.0:1783349904.774001:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783349904.774009:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3649:x1869977659502336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349904.774034:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349904.774477:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3649:x1869977659502336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 468us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.774485:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783349904.774667:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659502336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349904.775253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349904.776713:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659502208 00000100:00100000:1.0:1783349904.776724:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659502208 00000100:00100000:1.0:1783349904.776787:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783349904.776796:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659502208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783349904.776956:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349904.777031:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659502208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 237us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349904.777039:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783349904.777132:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659502208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349904.982490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349904.982595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349904.982634:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349904.982679:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642665472 00000100:00100000:3.0:1783349904.982689:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642665472 00000100:00100000:3.0:1783349904.982761:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 106 00000100:00100000:3.0:1783349904.982771:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642665472:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349904.982853:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642665472:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 83us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349904.982861:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 106 00000100:00080000:2.0:1783349904.984014:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349904.984458:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642665216 00000100:00100000:1.0:1783349904.984467:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642665216 00000100:00100000:1.0:1783349904.984558:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642665728 00000100:00100000:1.0:1783349904.984562:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642665728 00000100:00080000:0.0:1783349904.984620:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349904.984707:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 249 00000100:00100000:3.0:1783349904.984717:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+25:2399:x1869977642665216:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349904.984788:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+25:2399:x1869977642665216:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 73us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349904.984796:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 249 00000100:00100000:3.0:1783349904.984824:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 250 00000100:00100000:3.0:1783349904.984831:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642665728:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349904.984874:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642665728:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 43us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349904.984881:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 250 00000100:00100000:1.0:1783349904.989114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349904.989341:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349904.989372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349904.989406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349904.989439:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642665344 00000100:00100000:1.0:1783349904.989450:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642665344 00000100:00100000:1.0:1783349904.989513:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642665856 00000100:00100000:1.0:1783349904.989517:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642665856 00000100:00100000:1.0:1783349904.989552:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 251 00000100:00100000:1.0:1783349904.989561:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642665344:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349904.989630:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642665344:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 69us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349904.989638:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 251 00000100:00100000:1.0:1783349904.989672:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 252 00000100:00100000:1.0:1783349904.989679:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642665856:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349904.989706:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642665856:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349904.989712:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 252 00000100:00080000:1.0:1783349904.989729:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783349904.990092:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642665600 00000100:00100000:2.0:1783349904.990098:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642665600 00000100:00100000:2.0:1783349904.990130:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 107 00000100:00100000:2.0:1783349904.991560:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36df4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642665600:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349904.991619:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36df4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642665600:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 1482us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.991627:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 107 00000100:00100000:0.0:1783349904.992100:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642665088 00000100:00100000:0.0:1783349904.992107:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642665088 00000100:00100000:0.0:1783349904.992414:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 373 00000100:00100000:0.0:1783349904.992424:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642665088:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349904.992458:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642665088:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 36us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349904.992465:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 373 00010000:00010000:0.0:1783349905.028496:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783349905.307386:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1783349905.307402:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000040:00080000:1.0:1783349905.757484:0:14307:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349905.757494:0:14307:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349905.758494:0:14307:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783349905.758501:0:14307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349905.929304:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349905.930233:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642666112 00000100:00100000:1.0:1783349905.930245:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642666112 00000100:00100000:1.0:1783349905.930356:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 145 00000100:00100000:1.0:1783349905.930368:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+25:11401:x1869977642666112:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783349905.930388:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349905.930408:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2a2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded04d expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349905.930537:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2a32 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349905.930553:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349905.930565:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349905.930578:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783349905.930690:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2a2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded04d expref: 28 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783349905.930697:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783349905.930722:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2a32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded04d expref: 27 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349905.930732:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349905.930735:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783349905.930738:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c000, rc 0) 00000100:00100000:1.0:1783349905.930800:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+27:11401:x1869977642666112:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 434us (1503us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1783349905.931219:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 145 00000100:00100000:2.0:1783349905.946638:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349905.947799:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642666240 00000100:00100000:3.0:1783349905.947829:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642666240 00000100:00100000:3.0:1783349905.947905:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 146 00000100:00100000:3.0:1783349905.947914:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+27:11401:x1869977642666240:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1783349905.947992:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349905.948009:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349905.948021:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349905.948056:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349905.948063:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349905.948069:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349905.948075:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349905.948079:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349905.948096:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349905.948117:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:3.0:1783349905.948120:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783349905.948124:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349905.948129:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031e00/0xd05e6ae1590e2a40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349905.948237:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+27:11401:x1869977642666240:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 323us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349905.948245:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 146 00010000:00010000:0.0:1783349906.052421:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349906.070801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349906.070850:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642666368 00000100:00100000:3.0:1783349906.070861:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642666368 00000100:00080000:2.0:1783349906.070919:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349906.070933:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:3.0:1783349906.070943:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642666368:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:3.0:1783349906.070960:0:9981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349906.070982:0:9981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a95587b/0xd05e6ae1590e2a47 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded054 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783349906.071008:0:9981:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a4bc28d, atime: 0x6a4bc28d, ctime: 0x6a4bc28d, blocks: 0x8 00010000:00010000:3.0:1783349906.071029:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1783349906.071034:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349906.071043:0:9981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a95587b/0xd05e6ae1590e2a47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded054 expref: 7 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349906.071084:0:9981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a95587b/0xd05e6ae1590e2a47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded054 expref: 7 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349906.071098:0:9981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031e00, rc 0) 00000100:00100000:3.0:1783349906.071197:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+7:2401:x1869977642666368:12345-192.168.203.50@tcp:101:cat.0 Request processed in 256us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349906.071205:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:2.0:1783349906.074370:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349906.074498:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642666496 00000100:00100000:0.0:1783349906.074507:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642666496 00002000:00100000:0.0:1783349906.074571:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8ea2444ac700 x1869977642666496/t0(0) o3->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:657/0 lens 488/0 e 0 to 0 dl 1783349917 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783349906.074583:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea2444ac700 with x1869977642666496 ext(0->4095) 00002000:00010000:0.0:1783349906.074589:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea2444ac700 00000100:00100000:0.0:1783349906.074630:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1783349906.074639:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642666496:12345-192.168.203.50@tcp:3:cat.0 00000100:00100000:0.0:1783349906.075003:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642666496:12345-192.168.203.50@tcp:3:cat.0 Request processed in 363us (637us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783349906.075011:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00002000:00100000:0.0:1783349906.075017:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8ea2444ac700 x1869977642666496/t0(0) o3->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:657/0 lens 488/4536 e 0 to 0 dl 1783349917 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783349906.075026:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea2444ac700 with x1869977642666496 ext(0->4095) 00002000:00010000:0.0:1783349906.075030:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea2444ac700 00000100:00100000:2.0:1783349906.820702:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349906.820725:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659502464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783349906.821008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349906.831364:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659502464 00000100:00100000:0.0:1783349906.831380:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659502464 00000100:00100000:0.0:1783349906.831449:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783349906.831459:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659502464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783349906.831496:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783349906.833858:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659502464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2379us (12829us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349906.833873:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783349906.833965:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659502464:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783349907.083388:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349908.103071:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349908.356579:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659502592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349908.356648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349908.356834:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659502592 00000100:00100000:1.0:1783349908.356843:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659502592 00000100:00100000:1.0:1783349908.356904:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783349908.356914:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1869977659502592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349908.356940:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783349908.356984:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1869977659502592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349908.356991:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783349908.357241:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659502720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349908.357272:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349908.357311:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659502720 00000100:00100000:1.0:1783349908.357315:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659502720 00000100:00100000:1.0:1783349908.357340:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783349908.357360:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659502720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783349908.357370:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783349908.357399:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659502720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349908.357406:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783349908.357441:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659502720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349908.358132:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659502976:0@lo:400:kworker.0 00000100:00100000:1.0:1783349908.358288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349908.358321:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659503488:0@lo:400:kworker.0 00000100:00100000:1.0:1783349908.358344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349908.358366:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659504000:0@lo:400:kworker.0 00000100:00100000:1.0:1783349908.358386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349908.358407:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783349908.358412:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659503104:0@lo:400:kworker.0 00000100:00100000:1.0:1783349908.358439:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349908.358453:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659503616:0@lo:400:kworker.0 00000100:00100000:1.0:1783349908.358472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349908.358484:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659504128:0@lo:400:kworker.0 00000100:00100000:1.0:1783349908.358517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349908.358550:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659502976 00000100:00100000:1.0:1783349908.358555:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659502976 00000100:00100000:1.0:1783349908.358579:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659503488 00000100:00100000:1.0:1783349908.358581:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659503488 00000100:00100000:1.0:1783349908.358593:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659504000 00000100:00100000:1.0:1783349908.358595:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659504000 00000100:00100000:1.0:1783349908.358606:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659503616 00000100:00100000:1.0:1783349908.358616:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659503616 00000100:00100000:1.0:1783349908.358631:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659504128 00000100:00100000:1.0:1783349908.358634:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659504128 00000100:00100000:1.0:1783349908.358648:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783349908.358654:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659502976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.358766:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1783349908.358775:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659503488:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783349908.358833:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349908.358837:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783349908.358839:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349908.358853:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1783349908.358861:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659504000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349908.358943:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659502848:0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.363029:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659503488:12345-0@lo:400:kworker.0 Request processed in 4248us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349908.363044:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1783349908.363206:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1783349908.363220:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659503616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.363271:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659503616:12345-0@lo:400:kworker.0 Request processed in 56us (4798us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349908.363278:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1783349908.363305:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783349908.363311:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659504128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.363344:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659504128:12345-0@lo:400:kworker.0 Request processed in 33us (4826us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349908.363350:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783349908.363399:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659503104 00000100:00100000:2.0:1783349908.363407:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659503104 00000100:00100000:2.0:1783349908.363554:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783349908.363562:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659503104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.363597:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659503104:12345-0@lo:400:kworker.0 Request processed in 36us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349908.363603:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783349908.363651:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659502592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349908.363779:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659503232:0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.363814:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349908.363844:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659503744:0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.363870:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349908.363888:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659504256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349908.363911:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349908.363941:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659503232 00000100:00100000:2.0:1783349908.363945:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659503232 00000100:00100000:2.0:1783349908.363968:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783349908.363974:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659503232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.364006:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659503232:12345-0@lo:400:kworker.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349908.364023:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783349908.364210:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659503232:0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.364240:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659503744 00000100:00100000:2.0:1783349908.364244:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659503744 00000100:00100000:2.0:1783349908.364277:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783349908.364284:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659503744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.364319:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659503744:12345-0@lo:400:kworker.0 Request processed in 36us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349908.364325:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783349908.364351:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659503744:0@lo:400:kworker.0 00000100:00080000:2.0:1783349908.364373:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349908.364403:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659503104:0@lo:400:kworker.0 00010000:00080000:2.0:1783349908.364417:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2444ad500 x1869977659503616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349908.364427:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659503616:0@lo:400:kworker.0 00010000:00080000:2.0:1783349908.364438:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2444adc00 x1869977659504128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349908.364446:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659504128:0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.364457:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659503488:0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.364612:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659504256 00000100:00100000:2.0:1783349908.364616:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659504256 00000100:00100000:2.0:1783349908.364640:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783349908.364647:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659504256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783349908.364746:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349908.364788:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659504256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349908.364795:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783349908.364826:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659504256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349908.364935:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659504000:12345-0@lo:400:kworker.0 Request processed in 6074us (6546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349908.364944:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783349908.365024:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659504000:0@lo:400:kworker.0 00000100:00100000:0.0:1783349908.374908:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349908.375003:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659503360:0@lo:400:kworker.0 00000100:00100000:0.0:1783349908.375042:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349908.375080:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659503872:0@lo:400:kworker.0 00000100:00100000:0.0:1783349908.375104:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349908.375176:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659503872 00000100:00100000:0.0:1783349908.375184:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659503872 00000100:00100000:0.0:1783349908.375238:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783349908.375260:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659503872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349908.375314:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659503872:12345-0@lo:400:kworker.0 Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349908.375321:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1783349908.375343:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349908.375370:0:3649:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1783349908.375375:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1783349908.375391:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea37f5c8a80, transno 4294967302 00000004:00080000:0.0:1783349908.375402:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1783349908.375411:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea2439b5180, transno 4294967305 00000100:00100000:0.0:1783349908.375418:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659503872:0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.375703:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659502848 00000100:00100000:2.0:1783349908.375708:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659502848 00000100:00100000:2.0:1783349908.375738:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1783349908.375745:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659502848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349908.375784:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659502848:12345-0@lo:400:kworker.0 Request processed in 40us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349908.375791:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1783349908.375939:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659503360 00000100:00100000:3.0:1783349908.375943:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659503360 00000100:00100000:3.0:1783349908.375980:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783349908.375986:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659503360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349908.376023:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659503360:12345-0@lo:400:kworker.0 Request processed in 37us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349908.376039:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783349908.376086:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659502848:0@lo:400:kworker.0 00000100:00100000:3.0:1783349908.376098:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659503360:0@lo:400:kworker.0 00000100:00100000:1.0:1783349908.380703:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659502976:12345-0@lo:400:kworker.0 Request processed in 22038us (22405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349908.380717:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1783349908.380832:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659502976:0@lo:400:kworker.0 00000001:00080000:3.0:1783349908.381779:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1783349908.381803:0:6496:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ea24350b6c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1783349908.381807:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36dcf4f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ea24350b3c0 00000020:00080000:3.0:1783349908.381811:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36dcf4b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ea243a61800 00000020:00080000:3.0:1783349908.381828:0:6496:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1783349908.381963:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1783349908.382031:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1783349908.387817:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349908.387838:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349908.387855:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349908.387862:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349908.387868:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349908.388661:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349908.388684:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:2.0:1783349908.388688:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349908.388693:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349908.388699:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e29c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349909.128222:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783349909.406619:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1783349909.406634:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:2.0:1783349909.892953:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349909.892979:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659504384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349909.893050:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349909.893223:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659504384 00000100:00100000:2.0:1783349909.893231:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659504384 00000100:00100000:2.0:1783349909.893276:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783349909.893285:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659504384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783349909.893315:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349909.893434:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659504384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349909.893442:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783349909.893505:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659504384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349909.894321:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349909.894333:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659504512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349909.895303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349909.895393:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659504512 00000100:00100000:3.0:1783349909.895401:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659504512 00000100:00100000:3.0:1783349909.895528:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783349909.895539:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659504512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783349909.895558:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349909.895608:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659504512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349909.895615:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783349909.896590:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659504512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349910.115524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349910.115554:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349910.115589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349910.115618:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349910.115636:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349910.115652:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349910.115673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349910.115698:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642666880 00000100:00100000:2.0:1783349910.115717:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642666880 00000100:00100000:2.0:1783349910.115775:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642667392 00000100:00100000:2.0:1783349910.115778:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642667392 00000100:00100000:2.0:1783349910.115790:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642666752 00000100:00100000:2.0:1783349910.115792:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642666752 00000100:00100000:2.0:1783349910.115803:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642667264 00000100:00100000:2.0:1783349910.115806:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642667264 00000100:00100000:2.0:1783349910.115821:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 259 00000100:00100000:2.0:1783349910.115830:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642666880:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349910.115918:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642666880:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 88us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349910.115926:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 259 00000100:00100000:2.0:1783349910.115943:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 260 00000100:00100000:2.0:1783349910.115951:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642667392:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349910.115975:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642667392:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349910.115981:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 260 00000100:00100000:2.0:1783349910.115993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 261 00000100:00100000:2.0:1783349910.115998:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+13:2401:x1869977642666752:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349910.116043:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+13:2401:x1869977642666752:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 44us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349910.116050:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 261 00000100:00100000:2.0:1783349910.116069:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 262 00000100:00100000:2.0:1783349910.116074:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642667264:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349910.116098:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642667264:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349910.116104:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 262 00000100:00100000:2.0:1783349910.116125:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642667136 00000100:00100000:2.0:1783349910.116128:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642667136 00000100:00100000:2.0:1783349910.116185:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642667008 00000100:00100000:2.0:1783349910.116189:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642667008 00000100:00100000:2.0:1783349910.116209:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 110 00000100:00100000:2.0:1783349910.116216:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642667136:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349910.116245:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642667136:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349910.116250:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 110 00000100:00100000:2.0:1783349910.116262:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 111 00000100:00100000:2.0:1783349910.116268:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642667008:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349910.116290:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642667008:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349910.116295:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 111 00000100:00080000:2.0:1783349910.116310:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349910.116313:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349910.116316:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349910.116324:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783349910.116901:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642666624 00000100:00100000:1.0:1783349910.116907:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642666624 00000100:00100000:1.0:1783349910.116946:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 375 00000100:00100000:1.0:1783349910.116954:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2401:x1869977642666624:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349910.117002:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2401:x1869977642666624:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 49us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349910.117008:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 375 00010000:00010000:2.0:1783349910.155562:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349911.179106:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349911.961093:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659504640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783349911.961201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349911.961621:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659504640 00000100:00100000:0.0:1783349911.961629:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659504640 00000100:00100000:0.0:1783349911.961674:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783349911.961682:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659504640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783349911.961724:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1783349911.961771:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659504640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349911.961778:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783349911.962087:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659504640:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783349912.196657:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349913.200938:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349913.201022:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642667520 00000100:00100000:0.0:1783349913.201031:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642667520 00000100:00100000:0.0:1783349913.201101:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 147 00000100:00100000:0.0:1783349913.201120:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+13:11054:x1869977642667520:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783349913.201224:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+13:11054:x1869977642667520:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349913.201232:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 147 00000100:00080000:1.0:1783349913.201437:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349913.209789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349913.210787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642667648 00000100:00100000:0.0:1783349913.210799:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642667648 00000100:00100000:0.0:1783349913.210864:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 148 00000100:00100000:0.0:1783349913.210874:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:11054:x1869977642667648:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783349913.210961:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:11054:x1869977642667648:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 Request processed in 89us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349913.210969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 148 00000100:00080000:1.0:1783349913.211028:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349913.224283:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349913.224359:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642667904 00000100:00100000:1.0:1783349913.224368:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642667904 00000100:00100000:1.0:1783349913.224417:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:1.0:1783349913.224426:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+13:11054:x1869977642667904:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783349913.224643:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+14:11054:x1869977642667904:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 217us (366us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1783349913.224651:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00010000:00010000:2.0:1783349913.279019:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783349913.279970:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783349913.476315:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349913.476336:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659504768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349913.476406:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349913.476471:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659504768 00000100:00100000:1.0:1783349913.476479:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659504768 00000100:00100000:1.0:1783349913.476544:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783349913.476553:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659504768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783349913.476579:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783349913.476622:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659504768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349913.476629:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783349913.476670:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659504768:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783349913.476673:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349913.486447:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783349913.486478:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659504896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349913.486551:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349913.486905:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659505280:0@lo:400:kworker.0 00000100:00100000:3.0:1783349913.486954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349913.486975:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659505792:0@lo:400:kworker.0 00000100:00100000:3.0:1783349913.486999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349913.487028:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659506304:0@lo:400:kworker.0 00000100:00100000:3.0:1783349913.487048:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349913.487072:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783349913.487078:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659505408:0@lo:400:kworker.0 00000100:00100000:3.0:1783349913.487100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349913.487128:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659505920:0@lo:400:kworker.0 00000100:00100000:3.0:1783349913.487169:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349913.487194:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659504896 00000100:00100000:3.0:1783349913.487200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659504896 00000100:00100000:3.0:1783349913.488370:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659505280 00000100:00100000:3.0:1783349913.488376:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659505280 00000100:00100000:3.0:1783349913.488403:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783349913.488411:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659504896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783349913.488519:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783349913.488580:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659504896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 169us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349913.488588:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783349913.491553:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659505408 00000100:00100000:1.0:1783349913.491563:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659505408 00000100:00100000:1.0:1783349913.491609:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783349913.491618:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659505408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349913.491686:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659505408:12345-0@lo:400:kworker.0 Request processed in 70us (4584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349913.491694:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783349913.491716:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659505792 00000100:00100000:1.0:1783349913.491720:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659505792 00000100:00100000:1.0:1783349913.491746:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659506304 00000100:00100000:1.0:1783349913.491748:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659506304 00000100:00100000:1.0:1783349913.491764:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659505920 00000100:00100000:1.0:1783349913.491767:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659505920 00000100:00100000:1.0:1783349913.491781:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783349913.491786:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659505792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349913.491818:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659505792:12345-0@lo:400:kworker.0 Request processed in 32us (4819us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349913.491840:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783349913.491852:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783349913.491858:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659506304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349913.491886:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659506304:12345-0@lo:400:kworker.0 Request processed in 29us (4837us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349913.491892:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783349913.491902:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783349913.491907:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659505920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349913.491932:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659505920:12345-0@lo:400:kworker.0 Request processed in 26us (4763us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349913.491938:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783349913.491987:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659505408:0@lo:400:kworker.0 00000100:00100000:1.0:1783349913.491998:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659505920:0@lo:400:kworker.0 00000100:00100000:1.0:1783349913.492008:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659505792:0@lo:400:kworker.0 00000100:00100000:1.0:1783349913.492016:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1783349913.492021:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea2438bb100, transno 4294967311 00000004:00080000:1.0:1783349913.492030:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1783349913.492046:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659506304:0@lo:400:kworker.0 00000100:00100000:1.0:1783349913.492064:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659504896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783349913.492082:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349913.492094:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659506432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349913.493651:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783349913.495189:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659505152:0@lo:400:kworker.0 00000100:00100000:0.0:1783349913.495277:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659505024:0@lo:400:kworker.0 00000100:00100000:3.0:1783349913.496386:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659505280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349913.500768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349913.500828:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659505664:0@lo:400:kworker.0 00000100:00100000:2.0:1783349913.500858:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349913.500880:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659506176:0@lo:400:kworker.0 00000100:00100000:2.0:1783349913.500902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349913.501097:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659505152 00000100:00100000:2.0:1783349913.501104:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659505152 00000100:00100000:2.0:1783349913.501170:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659505664 00000100:00100000:2.0:1783349913.501173:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659505664 00000100:00100000:2.0:1783349913.501189:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659506176 00000100:00100000:2.0:1783349913.501192:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659506176 00000100:00100000:2.0:1783349913.501208:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783349913.501216:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659505152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349913.509726:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659505152:12345-0@lo:400:kworker.0 Request processed in 8501us (8956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349913.509740:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783349913.509778:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783349913.509789:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659505664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349913.509826:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659505664:12345-0@lo:400:kworker.0 Request processed in 41us (8967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349913.509849:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783349913.509861:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783349913.509868:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659506176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349913.509900:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659506176:12345-0@lo:400:kworker.0 Request processed in 32us (8997us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349913.509905:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783349913.509963:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659505152:0@lo:400:kworker.0 00010000:00080000:2.0:1783349913.509977:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f5c8a80 x1869977659505664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349913.509987:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659505664:0@lo:400:kworker.0 00010000:00080000:2.0:1783349913.509996:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37f5caa00 x1869977659506176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349913.510004:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659506176:0@lo:400:kworker.0 00000100:00080000:0.0:1783349913.510664:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349913.510670:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349913.510673:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349913.510728:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349913.510768:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659505536:0@lo:400:kworker.0 00000100:00100000:0.0:1783349913.510795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349913.510816:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659505536 00000100:00100000:0.0:1783349913.510821:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659505536 00000100:00100000:0.0:1783349913.510867:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783349913.510873:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659505536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349913.510908:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659505536:12345-0@lo:400:kworker.0 Request processed in 35us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349913.510925:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1783349913.510943:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349913.510960:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659505536:0@lo:400:kworker.0 00000100:00100000:0.0:1783349913.510967:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659506048:0@lo:400:kworker.0 00000100:00100000:0.0:1783349913.510987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349913.511003:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659506048 00000100:00100000:0.0:1783349913.511017:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659506048 00000100:00100000:0.0:1783349913.511041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783349913.511046:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659506048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349913.511073:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659506048:12345-0@lo:400:kworker.0 Request processed in 27us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349913.511079:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1783349913.511092:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349913.511107:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659506048:0@lo:400:kworker.0 00000100:00100000:2.0:1783349913.516625:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659505024 00000100:00100000:2.0:1783349913.516638:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659505024 00000100:00100000:2.0:1783349913.516705:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1783349913.516723:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659505024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349913.516810:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659505024:12345-0@lo:400:kworker.0 Request processed in 96us (6082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349913.516817:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1783349913.517618:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659505024:0@lo:400:kworker.0 00000100:00100000:3.0:1783349913.519854:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659505280:12345-0@lo:400:kworker.0 Request processed in 26186us (32892us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349913.519866:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783349913.521861:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349913.521918:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659505280:0@lo:400:kworker.0 00000100:00100000:3.0:1783349913.522868:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659506432 00000100:00100000:3.0:1783349913.522877:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659506432 00000100:00100000:3.0:1783349913.522931:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783349913.522940:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659506432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349913.522965:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783349913.523239:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659506432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 298us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349913.523257:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000001:00080000:0.0:1783349913.525603:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1783349913.525614:0:6496:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1783349913.526940:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1783349913.526955:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1783349913.529024:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659506432:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1783349913.669290:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349913.669299:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349913.669378:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1783349913.669386:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783349914.309000:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349915.013558:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783349915.013580:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659506688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349915.013639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349915.013698:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659506688 00000100:00100000:1.0:1783349915.013705:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659506688 00000100:00100000:1.0:1783349915.013759:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783349915.013768:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659506688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783349915.013792:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349915.014416:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659506560:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783349915.016112:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349915.024688:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659506688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10914us (11041us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349915.024703:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783349915.029248:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349915.029372:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659506688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783349915.029852:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659506560 00000100:00100000:1.0:1783349915.029860:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659506560 00000100:00100000:1.0:1783349915.029916:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783349915.029925:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659506560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349915.029949:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349915.030008:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659506560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349915.030016:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1783349915.030128:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349915.030989:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659506560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783349915.332340:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349916.390979:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349916.609929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349916.610043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349916.610084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349916.610115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349916.610177:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349916.610201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349916.610229:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349916.610253:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642668288 00000100:00100000:3.0:1783349916.610262:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642668288 00000100:00100000:3.0:1783349916.610329:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642668800 00000100:00100000:3.0:1783349916.610333:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642668800 00000100:00100000:3.0:1783349916.610349:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642668160 00000100:00100000:3.0:1783349916.610363:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642668160 00000100:00100000:3.0:1783349916.610380:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642668672 00000100:00100000:3.0:1783349916.610382:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642668672 00000100:00100000:3.0:1783349916.610400:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 269 00000100:00100000:3.0:1783349916.610409:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642668288:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349916.610552:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642668288:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 143us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349916.610559:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 269 00000100:00100000:3.0:1783349916.610574:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 270 00000100:00100000:3.0:1783349916.610581:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642668800:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349916.610604:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642668800:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 24us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349916.610610:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 270 00000100:00100000:3.0:1783349916.610619:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 271 00000100:00100000:3.0:1783349916.610623:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+13:2399:x1869977642668160:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349916.610643:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+13:2399:x1869977642668160:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 19us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349916.610647:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 271 00000100:00100000:0.0:1783349916.610742:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 272 00000100:00100000:0.0:1783349916.610750:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642668672:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349916.610775:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642668672:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349916.610796:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 272 00000100:00100000:0.0:1783349916.610922:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642668544 00000100:00100000:0.0:1783349916.610926:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642668544 00000100:00100000:0.0:1783349916.610951:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642668416 00000100:00100000:0.0:1783349916.610954:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642668416 00000100:00100000:0.0:1783349916.610970:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:0.0:1783349916.610975:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642668544:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349916.611004:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642668544:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 28us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349916.611010:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:0.0:1783349916.611023:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:0.0:1783349916.611028:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642668416:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349916.611047:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642668416:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 20us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349916.611052:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00080000:0.0:1783349916.611087:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349916.611090:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349916.611092:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783349916.611095:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783349916.611589:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642668032 00000100:00100000:2.0:1783349916.611600:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642668032 00000100:00100000:2.0:1783349916.611628:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 377 00000100:00100000:2.0:1783349916.611634:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642668032:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349916.611668:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642668032:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 34us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349916.611674:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 377 00000100:00100000:0.0:1783349916.774579:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349916.774756:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642668928 00000100:00100000:2.0:1783349916.774765:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642668928 00000100:00100000:2.0:1783349916.774824:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 149 00000100:00100000:2.0:1783349916.774834:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:11861:x1869977642668928:12345-192.168.203.50@tcp:101:lsof.0 00010000:00010000:2.0:1783349916.774853:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349916.774872:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2a4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded05b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349916.774933:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349916.774946:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349916.774956:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349916.774998:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783349916.775001:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349916.775034:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349916.775056:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2a4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded05b expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349916.775091:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded05b expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349916.775100:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:2.0:1783349916.775102:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349916.775106:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6400, rc 0) 00000100:00100000:2.0:1783349916.775211:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:11861:x1869977642668928:12345-192.168.203.50@tcp:101:lsof.0 Request processed in 377us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349916.775221:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 149 00000100:00100000:3.0:1783349917.060475:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659506816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783349917.060551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349917.060705:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659506816 00000100:00100000:2.0:1783349917.060714:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659506816 00000100:00100000:2.0:1783349917.060769:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783349917.060777:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659506816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783349917.060813:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1783349917.063382:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659506816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2598us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349917.063396:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783349917.067785:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659506816:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783349917.446126:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349918.469725:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349918.598046:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659506944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349918.598115:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349918.598209:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659506944 00000100:00100000:1.0:1783349918.598216:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659506944 00000100:00100000:1.0:1783349918.598267:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783349918.598275:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659506944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349918.598301:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783349918.598356:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659506944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349918.598376:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783349918.598431:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659506944:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783349918.598462:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349918.599951:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659507072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349918.600007:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349918.601675:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659507072 00000100:00100000:3.0:1783349918.601682:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659507072 00000100:00100000:3.0:1783349918.601947:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783349918.601956:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659507072:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783349918.601986:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659507200:0@lo:400:kworker.0 00000004:00000024:3.0:1783349918.601999:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783349918.602051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349918.602058:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659507072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349918.602066:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783349918.602092:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659507712:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.602107:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659507200 00000100:00100000:3.0:1783349918.602112:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659507200 00000100:00100000:1.0:1783349918.602124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349918.602161:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1783349918.602170:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659507200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349918.602174:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659508224:0@lo:400:kworker.0 00000100:00100000:1.0:1783349918.602200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349918.602218:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783349918.602224:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659507328:0@lo:400:kworker.0 00000100:00100000:1.0:1783349918.602246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349918.602259:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659507840:0@lo:400:kworker.0 00000100:00100000:1.0:1783349918.602276:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349918.602290:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659508352:0@lo:400:kworker.0 00000100:00100000:1.0:1783349918.602310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349918.602329:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659507712 00000100:00100000:0.0:1783349918.602335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659507712 00000100:00100000:1.0:1783349918.602347:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659508224 00000100:00100000:1.0:1783349918.602353:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659508224 00000100:00100000:0.0:1783349918.602378:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659507328 00000100:00100000:1.0:1783349918.602383:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659507840 00000100:00100000:0.0:1783349918.602383:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659507328 00000100:00100000:1.0:1783349918.602389:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659507840 00000100:00100000:0.0:1783349918.602403:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659508352 00000100:00100000:0.0:1783349918.602407:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659508352 00000100:00100000:1.0:1783349918.602423:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1783349918.602434:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659507712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349918.602449:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1783349918.602457:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659508224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349918.602480:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659507712:12345-0@lo:400:kworker.0 Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349918.602496:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1783349918.602501:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659508224:12345-0@lo:400:kworker.0 Request processed in 43us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349918.602508:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1783349918.602520:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1783349918.602527:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1783349918.602532:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659507328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349918.602539:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659507840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349918.602584:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659507328:12345-0@lo:400:kworker.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349918.602586:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659507840:12345-0@lo:400:kworker.0 Request processed in 49us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349918.602599:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1783349918.602736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659507200:12345-0@lo:400:kworker.0 Request processed in 568us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349918.602743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1783349918.602783:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659507584:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.602806:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349918.602817:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659508096:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.602837:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349918.602853:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659508608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349918.602870:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349918.602901:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659507072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349918.602929:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783349918.602933:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659507456:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.602952:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349918.602967:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659507968:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.602999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349918.603016:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659508480:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.603041:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349918.603061:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659508096 00000100:00100000:3.0:1783349918.603064:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659508096 00000100:00100000:3.0:1783349918.603086:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659507968 00000100:00100000:3.0:1783349918.603089:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659507968 00000100:00100000:3.0:1783349918.603101:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659508480 00000100:00100000:3.0:1783349918.603104:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659508480 00000100:00100000:3.0:1783349918.603117:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783349918.603122:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659508096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.603173:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659508096:12345-0@lo:400:kworker.0 Request processed in 51us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349918.603179:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783349918.603280:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783349918.603287:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659507968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.603315:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659507968:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349918.603320:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783349918.603330:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783349918.603335:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659508480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.603364:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659508480:12345-0@lo:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349918.603370:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783349918.603386:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659507456 00000100:00100000:3.0:1783349918.603389:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659507456 00000100:00100000:3.0:1783349918.603408:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783349918.603424:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659507456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.603453:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659507456:12345-0@lo:400:kworker.0 Request processed in 39us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349918.603466:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783349918.603493:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659508608 00000100:00100000:3.0:1783349918.603497:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659508608 00000100:00100000:3.0:1783349918.603517:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783349918.603522:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659508608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783349918.603537:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783349918.603566:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659508608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349918.603571:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783349918.603593:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659507456:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.603603:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659507968:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.603610:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659508480:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.603618:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659508096:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.603628:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659508608:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783349918.605539:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349918.605548:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783349918.605551:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349918.605554:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349918.605604:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659507328:0@lo:400:kworker.0 00010000:00080000:3.0:1783349918.605621:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36db7ed80 x1869977659507840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349918.605632:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659507840:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.605713:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659507200:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.605741:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659507712:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.605751:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659508224:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.605804:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659507584 00000100:00100000:3.0:1783349918.605809:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659507584 00000100:00100000:0.0:1783349918.606450:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1783349918.606479:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1783349918.606490:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659508352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349918.606571:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659508352:12345-0@lo:400:kworker.0 Request processed in 83us (4259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349918.606578:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00080000:0.0:1783349918.606612:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370d65f80 x1869977659508352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349918.606623:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659508352:0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.631840:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1783349918.631865:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659507584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349918.631970:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659507584:12345-0@lo:400:kworker.0 Request processed in 117us (29162us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349918.631978:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1783349918.632040:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659507584:0@lo:400:kworker.0 00010000:00010000:3.0:1783349919.496206:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349920.132510:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659508736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349920.132584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349920.132699:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659508736 00000100:00100000:1.0:1783349920.132707:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659508736 00000100:00100000:1.0:1783349920.132770:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783349920.132780:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659508736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783349920.132808:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349920.132869:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659508736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349920.132887:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783349920.132930:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659508736:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783349920.133191:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349920.133681:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659508864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349920.133718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349920.133796:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659508864 00000100:00100000:0.0:1783349920.133801:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659508864 00000100:00100000:0.0:1783349920.133861:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783349920.133891:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659508864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349920.133905:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349920.133939:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659508864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349920.133946:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1783349920.134215:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349920.134242:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659508864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349920.347815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349920.347863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349920.347900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349920.347994:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642669440 00000100:00100000:3.0:1783349920.348010:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642669440 00000100:00100000:3.0:1783349920.348085:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:3.0:1783349920.348095:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642669440:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349920.348193:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642669440:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 99us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349920.348201:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00080000:3.0:1783349920.348306:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349920.348576:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349920.348610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349920.348648:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642669056 00000100:00100000:3.0:1783349920.348653:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642669056 00000100:00100000:3.0:1783349920.348682:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 379 00000100:00100000:3.0:1783349920.348703:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2401:x1869977642669056:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349920.348741:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2401:x1869977642669056:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 39us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349920.348748:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 379 00000100:00100000:1.0:1783349920.349869:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349920.349909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349920.350638:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642669184 00000100:00100000:2.0:1783349920.350648:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642669184 00000100:00100000:2.0:1783349920.350772:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642669696 00000100:00100000:2.0:1783349920.350776:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642669696 00000100:00100000:2.0:1783349920.350796:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642669312 00000100:00100000:2.0:1783349920.350798:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642669312 00000100:00100000:2.0:1783349920.350816:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 279 00000100:00100000:2.0:1783349920.350849:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+13:2401:x1869977642669184:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349920.351200:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+13:2401:x1869977642669184:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 350us (3392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349920.351208:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 279 00000100:00100000:2.0:1783349920.351229:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 280 00000100:00100000:2.0:1783349920.351236:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2401:x1869977642669696:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349920.351263:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2401:x1869977642669696:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 28us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349920.351270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 280 00000100:00100000:2.0:1783349920.351282:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 281 00000100:00100000:2.0:1783349920.351289:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642669312:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349920.351314:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642669312:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349920.351320:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 281 00000100:00080000:2.0:1783349920.351350:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783349920.351354:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349920.356038:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642669568 00000100:00100000:1.0:1783349920.356050:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642669568 00000100:00100000:1.0:1783349920.356118:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:1.0:1783349920.356129:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642669568:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349920.356237:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642669568:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 111us (6372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349920.356245:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:2.0:1783349920.356386:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642669824 00000100:00100000:2.0:1783349920.356391:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642669824 00000100:00100000:2.0:1783349920.356438:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 282 00000100:00100000:2.0:1783349920.356446:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642669824:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349920.356482:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642669824:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 37us (6572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349920.356488:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 282 00000100:00080000:0.0:1783349920.356567:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349920.356571:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783349920.524019:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783349921.337830:0:14505:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:58:38 (1783349918) 00010000:00010000:0.0:1783349921.542517:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349922.180425:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659508992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783349922.180509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349922.180681:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659508992 00000100:00100000:0.0:1783349922.180689:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659508992 00000100:00100000:0.0:1783349922.180742:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783349922.180751:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659508992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783349922.180785:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1783349922.180843:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659508992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349922.180850:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783349922.180935:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659508992:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783349922.568266:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349923.102230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349923.102316:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642670080 00000100:00100000:2.0:1783349923.102325:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642670080 00000100:00080000:0.0:1783349923.102429:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349923.102474:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 150 00000100:00100000:2.0:1783349923.102485:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+13:12128:x1869977642670080:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349923.102505:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349923.102524:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2a5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded062 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102583:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2a63 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102596:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2a63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102607:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2a63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102619:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2a6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102626:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2a6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102632:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2a6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102711:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2a71 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102719:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2a71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102743:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2a71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349923.102752:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783349923.102827:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2a63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102834:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2a63 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102841:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2a63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102848:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349923.102852:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2a63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.102858:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2a63 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103341:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ea2424c5200) 00010000:00010000:2.0:1783349923.103346:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349923.103351:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2a63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103358:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2a63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103372:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2a6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103448:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2a6a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103462:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2a6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103468:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349923.103471:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2a6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103478:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2a6a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103486:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ea2424c5f00) 00010000:00010000:2.0:1783349923.103488:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349923.103491:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2a6a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103496:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2a6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103746:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2a5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded062 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103760:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2a71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded062 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.103767:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:2.0:1783349923.103770:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349923.103772:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6000, rc 0) 00000100:00100000:2.0:1783349923.103875:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+15:12128:x1869977642670080:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 1384us (1646us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1783349923.103892:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 150 00000100:00100000:2.0:1783349923.107260:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349923.107353:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349923.107440:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642670208 00000100:00100000:0.0:1783349923.107450:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642670208 00000100:00100000:0.0:1783349923.107506:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 151 00000100:00100000:0.0:1783349923.107515:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+15:12128:x1869977642670208:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783349923.107607:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642670336 00000100:00100000:3.0:1783349923.107613:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642670336 00000100:00100000:0.0:1783349923.107634:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+16:12128:x1869977642670208:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 119us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349923.107644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 151 00000100:00100000:3.0:1783349923.109455:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:3.0:1783349923.109475:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+15:2401:x1869977642670336:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349923.109495:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349923.109521:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2a71 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded062 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.109540:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:3.0:1783349923.109545:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349923.109604:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+14:2401:x1869977642670336:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 136us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349923.109612:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1783349923.115508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349923.115824:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642670464 00000100:00100000:1.0:1783349923.115833:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642670464 00000100:00100000:1.0:1783349923.115996:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 152 00000100:00100000:1.0:1783349923.116010:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:12128:x1869977642670464:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783349923.116358:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:12128:x1869977642670464:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 353us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.116375:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 152 00000100:00080000:0.0:1783349923.118434:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783349923.590755:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783349923.593906:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783349923.717183:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659509120:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.717286:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.717341:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659509632:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.717502:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.717524:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659510144:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.717547:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.717564:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659510656:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.717582:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.717796:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783349923.717805:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659509504:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.717845:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.717867:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659510016:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.717888:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.717904:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659510528:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.717922:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.717955:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659509248:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.717976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.717990:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659509760:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.718008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.718023:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659510272:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.718044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.718060:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783349923.718065:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659509376:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.718100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.718121:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659509888:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.718176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.718195:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659510400:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.718216:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.718246:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659509632 00000100:00100000:1.0:1783349923.719587:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659509504 00000100:00100000:1.0:1783349923.719611:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659509504 00000100:00100000:1.0:1783349923.719654:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659509248 00000100:00100000:1.0:1783349923.719658:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659509248 00000100:00100000:1.0:1783349923.720396:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659509760 00000100:00100000:1.0:1783349923.720403:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659509760 00000100:00100000:1.0:1783349923.720433:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659510272 00000100:00100000:1.0:1783349923.720436:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659510272 00000100:00100000:1.0:1783349923.720448:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659509888 00000100:00100000:1.0:1783349923.720450:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659509888 00000100:00100000:1.0:1783349923.720462:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659510400 00000100:00100000:1.0:1783349923.720465:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659510400 00000100:00100000:1.0:1783349923.720479:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1783349923.720489:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659509504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.720580:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659509504:12345-0@lo:400:kworker.0 Request processed in 92us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.720614:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1783349923.720631:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783349923.720637:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659509248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.720864:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659509248:12345-0@lo:400:kworker.0 Request processed in 226us (2885us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.720871:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783349923.720884:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1783349923.720891:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659509760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.720922:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659509760:12345-0@lo:400:kworker.0 Request processed in 32us (2912us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.720928:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1783349923.720940:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783349923.720946:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659510272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.720972:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659510272:12345-0@lo:400:kworker.0 Request processed in 26us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.720976:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783349923.720986:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1783349923.720991:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659509888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.721014:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659509888:12345-0@lo:400:kworker.0 Request processed in 23us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.721019:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1783349923.721028:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1783349923.721033:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659510400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.721054:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659510400:12345-0@lo:400:kworker.0 Request processed in 22us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.721065:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:1.0:1783349923.721155:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783349923.721159:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349923.721178:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659510784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349923.721213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783349923.721266:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2445c6d80 x1869977659509888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349923.721281:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659509888:0@lo:400:kworker.0 00010000:00080000:1.0:1783349923.721293:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2445c5c00 x1869977659510400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349923.721302:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659510400:0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.721314:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659509248:0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.721325:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659509760:0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.721334:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659510272:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.721782:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659509632 00000100:00100000:0.0:1783349923.721803:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659510144 00000100:00100000:0.0:1783349923.721806:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659510144 00000100:00100000:0.0:1783349923.721858:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659510656 00000100:00100000:0.0:1783349923.721862:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659510656 00000100:00100000:0.0:1783349923.721876:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659510016 00000100:00100000:0.0:1783349923.721879:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659510016 00000100:00100000:0.0:1783349923.721890:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659510528 00000100:00100000:0.0:1783349923.721892:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659510528 00000100:00100000:0.0:1783349923.721905:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783349923.721911:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659510144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.721966:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659510144:12345-0@lo:400:kworker.0 Request processed in 55us (4418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349923.721973:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783349923.721987:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783349923.721992:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659510656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.722017:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659510656:12345-0@lo:400:kworker.0 Request processed in 25us (4433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349923.722023:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783349923.722031:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783349923.722036:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659510016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.722058:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659510016:12345-0@lo:400:kworker.0 Request processed in 22us (4169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349923.722073:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783349923.722084:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783349923.722089:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659510528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.722116:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659510528:12345-0@lo:400:kworker.0 Request processed in 27us (4192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349923.722122:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783349923.722171:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659509376 00000100:00100000:0.0:1783349923.722174:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659509376 00000100:00100000:0.0:1783349923.722199:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783349923.722204:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659509376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.722236:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659509376:12345-0@lo:400:kworker.0 Request processed in 32us (4136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349923.722242:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783349923.723566:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659509376:0@lo:400:kworker.0 00000100:00080000:1.0:1783349923.724348:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349923.724476:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349923.724590:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659509504:0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.724971:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659510016:0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.724985:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659510528:0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.724997:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659510144:0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.725021:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659510656:0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.725102:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783349923.725114:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659509632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349923.725212:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659509632:12345-0@lo:400:kworker.0 Request processed in 99us (7709us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349923.725230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783349923.726031:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659509632:0@lo:400:kworker.0 00000100:00100000:3.0:1783349923.729563:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659509120 00000100:00100000:3.0:1783349923.729577:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659509120 00000100:00100000:3.0:1783349923.729631:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1783349923.729640:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659509120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349923.730393:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659509120:12345-0@lo:400:kworker.0 Request processed in 751us (13104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349923.730403:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1783349923.730445:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659510784 00000100:00100000:3.0:1783349923.730450:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659510784 00000100:00100000:3.0:1783349923.730479:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783349923.730485:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659510784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349923.730505:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783349923.730536:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659510784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (9323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349923.730543:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783349923.731605:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659510912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349923.731647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349923.731698:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659510912 00000100:00100000:1.0:1783349923.731703:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659510912 00000100:00100000:1.0:1783349923.731735:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783349923.731741:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659510912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783349923.731757:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783349923.731788:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659510912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.731794:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783349923.731832:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659510912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349923.732047:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659509120:0@lo:400:kworker.0 00000100:00100000:1.0:1783349923.732074:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659510784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349923.734595:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659511040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349923.740960:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349923.741289:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659511040 00000100:00100000:1.0:1783349923.741300:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659511040 00000100:00100000:1.0:1783349923.741346:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783349923.741367:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659511040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783349923.741414:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783349923.741476:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659511040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.741483:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783349923.741787:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659511040:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783349923.911769:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349923.911779:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349923.913898:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1783349923.913916:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1783349924.612508:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349925.253805:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349925.265607:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659511168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349925.265691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349925.265829:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659511168 00000100:00100000:0.0:1783349925.265836:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659511168 00000100:00100000:0.0:1783349925.265903:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783349925.265911:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659511168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783349925.265938:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349925.265980:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659511168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349925.266000:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783349925.266351:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24442fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659511296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349925.266400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349925.266444:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659511296 00000100:00100000:1.0:1783349925.266448:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659511296 00000100:00100000:1.0:1783349925.266474:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783349925.266480:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659511296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349925.266492:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349925.266519:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659511296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349925.266525:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783349925.266561:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24442fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659511296:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783349925.266699:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349925.266723:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659511168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783349925.498041:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349925.498097:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349925.498173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349925.498228:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642670848 00000100:00100000:1.0:1783349925.498237:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642670848 00000100:00100000:1.0:1783349925.498313:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642670720 00000100:00100000:1.0:1783349925.498316:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642670720 00000100:00100000:1.0:1783349925.498345:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 289 00000100:00100000:1.0:1783349925.498382:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642670848:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349925.498464:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642670848:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 110us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349925.498472:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 289 00000100:00100000:1.0:1783349925.498489:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 290 00000100:00100000:1.0:1783349925.498496:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+14:2402:x1869977642670720:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349925.498525:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+14:2402:x1869977642670720:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00080000:2.0:1783349925.498542:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349925.498548:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783349925.498548:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 290 00000100:00100000:3.0:1783349925.498970:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642670592 00000100:00100000:3.0:1783349925.498975:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642670592 00000100:00100000:3.0:1783349925.499014:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 381 00000100:00100000:3.0:1783349925.499022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642670592:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349925.499068:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642670592:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 47us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349925.499075:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 381 00000100:00100000:2.0:1783349925.520598:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349925.520643:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349925.520678:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349925.520702:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349925.520743:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642671232 00000100:00100000:2.0:1783349925.520753:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642671232 00000100:00100000:2.0:1783349925.520808:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642671360 00000100:00100000:2.0:1783349925.520811:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642671360 00000100:00100000:2.0:1783349925.520834:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 291 00000100:00100000:2.0:1783349925.520844:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2401:x1869977642671232:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349925.520914:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2401:x1869977642671232:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349925.520923:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 291 00000100:00100000:2.0:1783349925.520954:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 292 00000100:00100000:2.0:1783349925.520960:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642671360:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349925.520987:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642671360:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349925.520993:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 292 00000100:00080000:2.0:1783349925.521010:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783349925.521013:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349925.521833:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642670976 00000100:00100000:0.0:1783349925.521841:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642670976 00000100:00100000:0.0:1783349925.521889:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642671104 00000100:00100000:0.0:1783349925.521893:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642671104 00000100:00100000:0.0:1783349925.521919:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:0.0:1783349925.521927:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642671104:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349925.521970:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642671104:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 44us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349925.521982:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:0.0:1783349925.521997:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:0.0:1783349925.522002:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24442f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2398:x1869977642670976:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:0.0:1783349925.522033:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2419 00000100:00080000:0.0:1783349925.522041:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8ea2437de800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783349925.522078:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967305 00000100:00100000:0.0:1783349925.522245:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24442f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+2:2398:x1869977642670976:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 242us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349925.522252:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00080000:0.0:1783349925.522288:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349925.522290:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783349925.522688:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349925.637452:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349926.089338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349926.092518:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642671488 00000100:00100000:0.0:1783349926.092532:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642671488 00000100:00100000:0.0:1783349926.092606:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 153 00000100:00100000:0.0:1783349926.092616:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+14:12171:x1869977642671488:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349926.092634:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349926.092653:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2a7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded069 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092724:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2a86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092739:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092749:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092761:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2a8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092766:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092772:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092828:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092835:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2a86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092842:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2a86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092847:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364be00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349926.092850:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2a86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092867:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2a86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092883:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:0.0:1783349926.092886:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349926.092890:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092895:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e2a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092918:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092924:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2a8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092929:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092934:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364ac00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349926.092937:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092942:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2a8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092948:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ea343b1e100) 00010000:00010000:0.0:1783349926.092950:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349926.092953:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2a8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.092969:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ac00/0xd05e6ae1590e2a8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.093021:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2a7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded069 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.093031:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:0.0:1783349926.093032:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349926.093036:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2a7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded069 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.093056:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b200, rc 0) 00000100:00100000:0.0:1783349926.093117:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+14:12171:x1869977642671488:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 500us (3784us total) trans 0 rc 301/301 00000100:00100000:0.0:1783349926.093124:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 153 00000100:00100000:2.0:1783349926.099981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349926.102861:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642671744 00000100:00100000:0.0:1783349926.102872:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642671744 00000100:00100000:0.0:1783349926.102939:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 154 00000100:00100000:0.0:1783349926.102949:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+14:12171:x1869977642671744:12345-192.168.203.50@tcp:36:lfs.0 00010000:00010000:0.0:1783349926.103001:0:12147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349926.103025:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e23d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece8d expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.103041:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:0.0:1783349926.103045:0:12147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349926.103093:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.103114:0:12147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded05b expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.103122:0:12147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.103173:0:12147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded05b expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.103187:0:12147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded05b expref: 5 pid: 6517 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349926.103201:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659511424:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349926.103283:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cb4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349926.111660:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659511424:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349926.111701:0:12147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349926.112466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349926.115447:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642671872 00000100:00100000:0.0:1783349926.115460:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642671872 00010000:00010000:0.0:1783349926.115498:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded05b expref: 6 pid: 6517 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349926.115535:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:0.0:1783349926.115545:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2399:x1869977642671872:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349926.115558:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349926.115565:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded05b expref: 6 pid: 6517 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.115577:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded05b expref: 6 pid: 6517 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.115671:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2a55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded05b expref: 6 pid: 6517 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.115684:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:0.0:1783349926.115689:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.115698:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.115704:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.115730:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349926.115800:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642671872:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 256us (3337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349926.115807:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 80 00010000:00010000:1.0:1783349926.117289:0:12147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117301:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117325:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117336:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117368:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117835:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117845:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117852:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349926.117865:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035f7efec reply state 000000000526f24d transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117876:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117889:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:1.0:1783349926.117892:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349926.117895:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783349926.117901:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783349926.117908:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117914:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117921:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117926:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349926.117931:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117937:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117946:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:1.0:1783349926.117948:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349926.117951:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117957:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2a94 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349926.117971:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035f7efec reply state 000000000526f24d transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117990:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.117996:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ea24311df00) 00010000:00010000:1.0:1783349926.117998:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349926.118000:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783349926.118061:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+15:12171:x1869977642671744:12345-192.168.203.50@tcp:36:lfs.0 Request processed in 15112us (18085us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1783349926.118070:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 154 00000100:00100000:0.0:1783349926.226321:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349926.227077:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642672000 00000100:00100000:2.0:1783349926.227088:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642672000 00000100:00100000:2.0:1783349926.227395:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 155 00000100:00100000:2.0:1783349926.227407:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+15:12179:x1869977642672000:12345-192.168.203.50@tcp:101:lctl.0 00010000:00010000:2.0:1783349926.227861:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349926.227887:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2aa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded070 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.228234:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2ab0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.228248:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.228261:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349926.228304:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783349926.228308:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349926.228327:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.228382:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2aa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded070 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.228400:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded070 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.228409:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5d00) 00010000:00010000:2.0:1783349926.228412:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349926.228416:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7200, rc 0) 00000100:00100000:2.0:1783349926.228493:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+16:12179:x1869977642672000:12345-192.168.203.50@tcp:101:lctl.0 Request processed in 1088us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349926.228500:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 155 00000100:00100000:0.0:1783349926.379586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349926.380111:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642672128 00000100:00100000:3.0:1783349926.380122:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642672128 00000100:00100000:3.0:1783349926.380217:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 156 00000100:00100000:3.0:1783349926.380227:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+16:12185:x1869977642672128:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1783349926.380254:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349926.380274:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2ab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded077 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.380333:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2abe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.380353:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.380377:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.380390:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2ac5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.380398:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.380405:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.380483:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2acc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.380510:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2acc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.380518:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2acc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349926.380552:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783349926.380556:0:8582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349926.380578:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2acc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381650:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381664:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2abe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381671:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2abe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381678:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349926.381682:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2abe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381691:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2abe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381704:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5d00) 00010000:00010000:3.0:1783349926.381707:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349926.381711:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2abe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381744:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381762:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381768:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381774:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381843:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349926.381847:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381853:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381862:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ea24311df00) 00010000:00010000:3.0:1783349926.381864:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349926.381867:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2ac5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.381873:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2ac5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.382760:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded077 expref: 18 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.382792:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2acc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded077 expref: 17 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.382809:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:3.0:1783349926.382812:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783349926.382815:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030200, rc 0) 00000100:00100000:3.0:1783349926.382885:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+17:12185:x1869977642672128:12345-192.168.203.50@tcp:101:bash.0 Request processed in 2658us (3308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349926.383064:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 156 00000100:00100000:1.0:1783349926.386555:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349926.386730:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642672384 00000100:00100000:2.0:1783349926.386740:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642672384 00000100:00100000:2.0:1783349926.386811:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 157 00000100:00100000:2.0:1783349926.386822:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+17:12185:x1869977642672384:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783349926.386842:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349926.386861:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2ad3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded07e expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.387216:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2ada lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.387232:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2ada lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.387242:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2ada lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.387271:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.387279:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.387287:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349926.387707:0:12147:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1783349926.388057:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.388068:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.388076:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.388108:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2ada lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.388115:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2ada lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.388121:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2ada lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.388126:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349926.388130:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2ada lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.388867:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2ada lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.388880:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349926.388884:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349926.388888:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2ada lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.388969:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2ada lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349926.388987:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e73bce0 reply state 0000000054204f2f transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.388998:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.389005:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea2424c5100) 00010000:00010000:2.0:1783349926.389008:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783349926.389011:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783349926.389044:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e2ad3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded07e expref: 20 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.389058:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded07e expref: 19 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.389065:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea2424c5b00) 00010000:00010000:2.0:1783349926.389067:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349926.389069:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6400, rc 0) 00000100:00100000:2.0:1783349926.395032:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+20:12185:x1869977642672384:12345-192.168.203.50@tcp:101:bash.0 Request processed in 8198us (8471us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1783349926.395047:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 157 00000100:00100000:2.0:1783349926.402927:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349926.403021:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642672512 00000100:00100000:1.0:1783349926.403032:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642672512 00000100:00100000:1.0:1783349926.403079:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:1.0:1783349926.403086:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1869977642672512:12345-192.168.203.50@tcp:8:bash.0 00010000:00080000:1.0:1783349926.403127:0:13811:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:1.0:1783349926.403483:0:13811:0:(genops.c:1406:class_connect()) connect: client 689af055-7605-419d-81ba-26cff8cb556b, cookie 0xd05e6ae1590e2af6 00002000:00100000:1.0:1783349926.403497:0:13811:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 689af055-7605-419d-81ba-26cff8cb556b/ffff8ea37f56a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 25255936 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783349926.403509:0:13811:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783349926.403596:0:13811:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783349926.403624:0:13811:0:(import.c:65:import_set_state_nolock()) ffff8ea37f56f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349926.403700:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+6:2398:x1869977642672512:12345-192.168.203.50@tcp:8:bash.0 Request processed in 612us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349926.403708:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:0.0:1783349926.405796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349926.406178:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642672640 00000100:00100000:2.0:1783349926.406185:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642672640 00000100:00100000:2.0:1783349926.406250:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:2.0:1783349926.406269:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+6:0:x1869977642672640:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783349926.406284:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349926.406303:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000675647c1/0xd05e6ae1590e2afd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded085 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783349926.406320:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1783349926.406329:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783349926.406348:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:2.0:1783349926.406352:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349926.406370:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000675647c1/0xd05e6ae1590e2afd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded085 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.406387:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000675647c1/0xd05e6ae1590e2afd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded085 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.406402:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7400, rc 0) 00000100:00100000:2.0:1783349926.406461:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+7:0:x1869977642672640:12345-192.168.203.50@tcp:101:bash.0 Request processed in 194us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349926.406468:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:3.0:1783349926.410944:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349926.411115:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642672768 00000100:00100000:0.0:1783349926.411123:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642672768 00000100:00100000:0.0:1783349926.411208:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:0.0:1783349926.411221:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+7:12185:x1869977642672768:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349926.411237:0:9981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349926.411250:0:9981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded08c expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.411288:0:9981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000675647c1/0xd05e6ae1590e2afd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded085 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.411295:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349926.411298:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349926.411302:0:9981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 8 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.411377:0:9981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000675647c1/0xd05e6ae1590e2afd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded085 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.411407:0:9981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000675647c1/0xd05e6ae1590e2afd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded085 expref: 8 pid: 8431 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349926.411480:0:9981:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9981:1869977659511552:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349926.411576:0:9981:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349926.415488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349926.415755:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642672896 00000100:00100000:2.0:1783349926.415775:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642672896 00010000:00010000:2.0:1783349926.415813:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000675647c1/0xd05e6ae1590e2afd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded085 expref: 9 pid: 8431 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349926.415853:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:2.0:1783349926.415862:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+9:2400:x1869977642672896:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349926.415877:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349926.415895:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000675647c1/0xd05e6ae1590e2afd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded085 expref: 9 pid: 8431 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.415908:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000675647c1/0xd05e6ae1590e2afd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded085 expref: 9 pid: 8431 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.415932:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349926.415936:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349926.415944:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 9 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.415953:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 9 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.415987:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 9 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349926.416000:0:6502:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6502:1869977659511680:192.168.203.50@tcp:105: 00000100:00100000:2.0:1783349926.416071:0:6502:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2439636c0 going to sleep for 11 seconds 00010000:00010000:1.0:1783349926.416646:0:9981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000675647c1/0xd05e6ae1590e2afd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded085 expref: 9 pid: 8431 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349926.416662:0:9981:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9981:1869977659511552:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349926.416684:0:9981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 8 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.416694:0:9981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b800, rc 0) 00000100:00100000:1.0:1783349926.416773:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+8:12185:x1869977642672768:12345-192.168.203.50@tcp:101:bash.0 Request processed in 5558us (5837us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349926.416781:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:2.0:1783349926.418093:0:6502:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6502:1869977659511680:192.168.203.50@tcp:105: 00010000:00010000:2.0:1783349926.418865:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349926.418954:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642672896:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 3091us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349926.418966:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:3.0:1783349926.419069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349926.419204:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642673152 00000100:00100000:2.0:1783349926.419210:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642673152 00000100:00100000:2.0:1783349926.419250:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:2.0:1783349926.419259:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+20:12185:x1869977642673152:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:2.0:1783349926.420608:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+21:12185:x1869977642673152:12345-192.168.203.50@tcp:35:bash.0 Request processed in 1343us (1533us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1783349926.420619:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:3.0:1783349926.574237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349926.575343:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642673408 00000100:00100000:2.0:1783349926.575365:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642673408 00000100:00100000:2.0:1783349926.575445:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 158 00000100:00100000:2.0:1783349926.575455:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+21:12195:x1869977642673408:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349926.575480:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349926.575499:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded093 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349926.576032:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783349926.576129:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded093 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.576179:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5d00) 00010000:00010000:2.0:1783349926.576182:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349926.576202:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded093 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.576216:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7c00, rc 0) 00000100:00100000:2.0:1783349926.576932:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+22:12195:x1869977642673408:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1474us (2706us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1783349926.576941:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 158 00000100:00100000:0.0:1783349926.608653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349926.610016:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642673664 00000100:00100000:1.0:1783349926.610028:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642673664 00000100:00100000:1.0:1783349926.610097:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:1.0:1783349926.610107:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+22:12195:x1869977642673664:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1783349926.610686:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+23:12195:x1869977642673664:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 578us (2040us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1783349926.610696:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 37 00010000:00010000:3.0:1783349926.660706:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349926.822244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349926.822478:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642673792 00000100:00100000:3.0:1783349926.822489:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642673792 00000100:00100000:3.0:1783349926.822548:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 159 00000100:00100000:3.0:1783349926.822559:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+23:12201:x1869977642673792:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349926.822592:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349926.822613:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2b19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded09a expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.822674:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2b20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.822687:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.822698:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349926.822756:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783349926.822759:0:8582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349926.822775:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.822797:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2b19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded09a expref: 25 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.822814:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2b20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded09a expref: 24 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.822822:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:3.0:1783349926.822826:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349926.822829:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031800, rc 0) 00000100:00100000:3.0:1783349926.822895:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+24:12201:x1869977642673792:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 338us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349926.822902:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 159 00000100:00100000:3.0:1783349926.838643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349926.838840:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642674048 00000100:00100000:2.0:1783349926.838849:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642674048 00000100:00100000:2.0:1783349926.838908:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 160 00000100:00100000:2.0:1783349926.838917:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+24:12201:x1869977642674048:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349926.838936:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349926.838954:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0a1 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.839055:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e2b2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.839069:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e2b2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.839080:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e2b2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349926.839090:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783349926.839218:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0a1 expref: 27 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.839250:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e2b2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0a1 expref: 26 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.839272:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea2424c5b00) 00010000:00010000:2.0:1783349926.839275:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349926.839278:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7e00, rc 0) 00000100:00100000:2.0:1783349926.839338:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+26:12201:x1869977642674048:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 422us (704us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1783349926.839345:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 160 00000100:00100000:1.0:1783349926.857552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349926.857605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349926.857734:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642674432 00000100:00100000:3.0:1783349926.857744:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642674432 00000100:00100000:3.0:1783349926.857810:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:3.0:1783349926.857821:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+26:2399:x1869977642674432:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349926.857837:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349926.857860:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e2b2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0a1 expref: 26 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.857878:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea2424c5b00) 00010000:00010000:3.0:1783349926.857895:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349926.857955:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+25:2399:x1869977642674432:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 136us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349926.857973:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:2.0:1783349926.858236:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642674304 00000100:00100000:2.0:1783349926.858242:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642674304 00000100:00100000:2.0:1783349926.858276:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 161 00000100:00100000:2.0:1783349926.858284:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+25:12201:x1869977642674304:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349926.858302:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349926.858316:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.858434:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2b43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.858448:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2b43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.858458:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2b43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349926.858469:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783349926.858566:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0a8 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.858607:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2b43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0a8 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.858616:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea2424c5b00) 00010000:00010000:2.0:1783349926.858618:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783349926.858621:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6c00, rc 0) 00000100:00100000:2.0:1783349926.858651:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+27:12201:x1869977642674304:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 368us (1110us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1783349926.858658:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 161 00000100:00100000:1.0:1783349926.880801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349926.881364:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642674560 00000100:00100000:2.0:1783349926.881374:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642674560 00000100:00100000:2.0:1783349926.881473:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:2.0:1783349926.881483:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+7:2399:x1869977642674560:12345-192.168.203.50@tcp:1:lfs.0 00010000:00010000:2.0:1783349926.881538:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.881567:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 7 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.881575:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349926.881580:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349926.881584:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.881620:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 7 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.881646:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 7 pid: 9981 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349926.881662:0:13811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13811:1869977659511808:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349926.881758:0:13811:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963540 going to sleep for 11 seconds 00000100:00100000:1.0:1783349926.888211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349926.888279:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642674688 00000100:00100000:0.0:1783349926.888289:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642674688 00002000:00100000:0.0:1783349926.888340:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8ea2445c4380 x1869977642674688/t0(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:677/0 lens 504/0 e 0 to 0 dl 1783349937 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783349926.888361:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea2445c4380 with x1869977642674688 ext(0->12) 00010000:00010000:0.0:1783349926.888371:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 8 pid: 9981 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.888504:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 8 pid: 9981 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349926.888562:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ea2445c4380 00000100:00100000:0.0:1783349926.888737:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:2.0:1783349926.888741:0:13811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13811:1869977659511808:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349926.888747:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642674688:12345-192.168.203.50@tcp:4:lfs.0 00010000:00010000:2.0:1783349926.888764:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1783349926.890204:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000001:00100000:2.0:1783349926.890215:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:2.0:1783349926.890218:0:8426:0:(genops.c:906:class_export_put()) final put ffff8ea2437df800/689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:3.0:1783349926.890691:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2437df800/689af055-7605-419d-81ba-26cff8cb556b for lustre-OST0000 00000020:00000080:3.0:1783349926.890742:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2437de800 for lustre-OST0000 00000100:00100000:0.0:1783349926.890946:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642674688:12345-192.168.203.50@tcp:4:lfs.0 Request processed in 2195us (2739us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783349926.890957:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00002000:00100000:0.0:1783349926.890969:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8ea2445c4380 x1869977642674688/t4294967306(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:677/0 lens 504/448 e 0 to 0 dl 1783349937 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783349926.890978:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea2445c4380 with x1869977642674688 ext(0->12) 00010000:00010000:0.0:1783349926.890989:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 9 pid: 9981 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.891005:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 9 pid: 9981 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349926.891013:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ea2445c4380 00000100:00100000:1.0:1783349926.904045:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349926.904199:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642674816 00000100:00100000:3.0:1783349926.904208:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642674816 00010000:00010000:3.0:1783349926.904246:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 9 pid: 9981 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349926.904293:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 82 00000100:00100000:3.0:1783349926.904304:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642674816:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349926.904321:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783349926.904346:0:7459:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783349926.904349:0:7459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783349925 00002000:00010000:3.0:1783349926.904374:0:7459:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783349926 00002000:00010000:3.0:1783349926.904377:0:7459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1783349925 00002000:00010000:3.0:1783349926.904379:0:7459:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783349926.904386:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 9 pid: 9981 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.904401:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 9 pid: 9981 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.904423:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e2b04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded08c expref: 9 pid: 9981 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.904470:0:7459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349926.904474:0:7459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349926.904479:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.904489:0:7459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349926.904523:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349926.904584:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642674816:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 274us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349926.904592:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 82 00010000:00010000:2.0:1783349926.904774:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.904784:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.904805:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.904814:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.904834:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.904841:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783349926.904845:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.904854:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.904867:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.904875:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bb092d9/0xd05e6ae1590e2b51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349926.904922:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+7:2399:x1869977642674560:12345-192.168.203.50@tcp:1:lfs.0 Request processed in 23440us (24131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349926.904930:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:3.0:1783349926.913994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349926.915766:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642675072 00000100:00100000:0.0:1783349926.915780:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642675072 00000100:00100000:0.0:1783349926.916088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:0.0:1783349926.916100:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+27:12201:x1869977642675072:12345-192.168.203.50@tcp:35:lfs.0 00000004:00010000:0.0:1783349926.916187:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2b43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0a8 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349926.916783:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1783349926.916818:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1783349926.918081:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1783349926.918133:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.918287:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded07e expref: 31 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.918310:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.918425:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded07e expref: 31 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.918439:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded07e expref: 31 pid: 12147 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349926.919296:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1869977659511936:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349926.919803:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea341377840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349926.923774:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1869977659511936:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349926.923876:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349926.924771:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349926.924862:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642675200 00000100:00100000:2.0:1783349926.924870:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642675200 00010000:00010000:2.0:1783349926.924969:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded07e expref: 32 pid: 12147 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349926.925019:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00100000:2.0:1783349926.925042:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244567b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+32:2400:x1869977642675200:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349926.925058:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349926.925065:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded07e expref: 32 pid: 12147 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.925077:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded07e expref: 32 pid: 12147 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.925099:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2ae8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded07e expref: 32 pid: 12147 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.925115:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea2424c5b00) 00010000:00010000:2.0:1783349926.925120:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.925129:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.925505:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349926.925536:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349926.925589:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244567b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+31:2400:x1869977642675200:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 548us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349926.925598:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 83 00010000:00010000:1.0:1783349926.926045:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349926.926053:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783349926.926176:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1783349926.926286:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1783349926.926583:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445c5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1869977659512064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783349926.926636:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349926.926835:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf900 going to sleep for 11 seconds 00000100:00100000:0.0:1783349926.928934:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659512064 00000100:00100000:0.0:1783349926.928946:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659512064 00000100:00100000:0.0:1783349926.929079:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783349926.929091:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1869977659512064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783349926.934088:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1869977659512064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 4991us (7442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349926.934103:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783349926.936008:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445c5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1869977659512064:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783349926.938748:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1783349926.938843:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a07100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1869977659512192:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783349926.938909:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349926.939004:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349926.939052:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659512192 00000100:00100000:0.0:1783349926.939059:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659512192 00000100:00100000:2.0:1783349926.942411:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783349926.942438:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1869977659512192:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783349926.943419:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1869977659512192:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 989us (4505us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783349926.943429:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783349926.943538:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a07100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1869977659512192:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783349926.943604:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1783349926.943663:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.943673:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.943680:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.943686:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349926.943691:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.943699:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.943715:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea2424c5b00) 00010000:00010000:0.0:1783349926.943718:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783349926.943722:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.943728:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b58 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783349926.943822:0:6520:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783349926.944528:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1783349926.944542:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367739405000ns, next at 368739401945ns, rc = 0 00000001:00080000:0.0:1783349926.944548:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1783349926.944577:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea2424c5b00) 00010000:00010000:0.0:1783349926.944581:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783349926.944588:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2b43 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0a8 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349926.944949:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+34:12201:x1869977642675072:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 28850us (30964us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1783349926.944958:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00000020:00080000:0.0:1783349926.944964:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783349926.952657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349926.952750:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642675328 00000100:00100000:0.0:1783349926.952761:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642675328 00000100:00100000:0.0:1783349926.952822:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 162 00000100:00100000:0.0:1783349926.952832:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+34:12201:x1869977642675328:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349926.952856:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349926.952877:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.953057:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0af expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.953074:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0af expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349926.953095:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:0.0:1783349926.953098:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349926.953103:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b800, rc 0) 00000100:00100000:3.0:1783349926.953368:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+35:12201:x1869977642675328:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 536us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349926.953376:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 162 00000100:00100000:0.0:1783349926.969073:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349926.969176:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642675584 00000100:00100000:1.0:1783349926.969186:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642675584 00000100:00100000:1.0:1783349926.969237:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:1.0:1783349926.969248:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+35:12201:x1869977642675584:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1783349926.969481:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+36:12201:x1869977642675584:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 234us (416us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1783349926.969490:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:1.0:1783349927.188252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349927.188454:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642675840 00000100:00100000:2.0:1783349927.188474:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642675840 00000100:00100000:2.0:1783349927.188544:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 163 00000100:00100000:2.0:1783349927.188555:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+36:12211:x1869977642675840:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349927.188588:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349927.188608:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0b6 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349927.188712:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000100:00080000:1.0:1783349927.189021:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783349927.189232:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0b6 expref: 38 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.189246:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5d00) 00010000:00010000:2.0:1783349927.189249:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349927.189254:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0b6 expref: 38 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.189267:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6400, rc 0) 00000100:00100000:2.0:1783349927.189338:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+37:12211:x1869977642675840:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 778us (1088us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1783349927.189347:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 163 00000100:00100000:3.0:1783349927.202434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349927.202724:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642675968 00000100:00100000:2.0:1783349927.202735:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642675968 00000100:00100000:2.0:1783349927.202801:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 164 00000100:00100000:2.0:1783349927.202811:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+37:12211:x1869977642675968:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:2.0:1783349927.202993:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b74 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203027:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203039:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203051:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203058:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203065:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203265:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203276:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203283:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349927.203339:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203377:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203383:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b74 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203390:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203396:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349927.203401:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203410:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b74 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203421:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349927.203424:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349927.203428:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203433:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203445:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203451:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.203457:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204312:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349927.204317:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204325:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204344:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea2424c5100) 00010000:00010000:2.0:1783349927.204347:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349927.204358:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204365:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204380:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204387:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204393:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204397:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349927.204400:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204406:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204425:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349927.204427:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349927.204431:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.204436:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349927.205020:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+37:12211:x1869977642675968:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 2198us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349927.205031:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 164 00000100:00100000:1.0:1783349927.208395:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349927.208622:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642676224 00000100:00100000:2.0:1783349927.208646:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642676224 00000100:00100000:2.0:1783349927.208709:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:2.0:1783349927.208721:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+37:12211:x1869977642676224:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349927.209736:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+38:12211:x1869977642676224:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 1010us (1348us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1783349927.209748:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:1.0:1783349927.300775:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659512320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349927.300881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349927.301447:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659512320 00000100:00100000:3.0:1783349927.301456:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659512320 00000100:00100000:3.0:1783349927.301620:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783349927.301629:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659512320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783349927.301663:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783349927.301828:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659512320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 199us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349927.301837:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783349927.301922:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659512320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349927.308711:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349927.308924:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642676480 00000100:00100000:2.0:1783349927.308935:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642676480 00000100:00100000:2.0:1783349927.309001:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 165 00000100:00100000:2.0:1783349927.309203:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+38:12214:x1869977642676480:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349927.309227:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349927.309246:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309319:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b90 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309412:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309427:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309441:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309449:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309455:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309720:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309729:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309737:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349927.309746:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783349927.309815:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309822:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b90 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309829:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309841:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349927.309845:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309852:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309864:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349927.309867:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349927.309872:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309878:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2b90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309891:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309897:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309903:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309908:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349927.309910:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309916:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309933:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea2424c5100) 00010000:00010000:2.0:1783349927.309935:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349927.309938:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309945:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2b97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309979:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2b89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0bd expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.309993:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0bd expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.310000:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349927.310003:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349927.310291:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7000, rc 0) 00000100:00100000:2.0:1783349927.310374:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+40:12214:x1869977642676480:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1175us (1672us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1783349927.310383:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 165 00000100:00100000:3.0:1783349927.321564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349927.321819:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642676608 00000100:00100000:2.0:1783349927.321829:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642676608 00000100:00100000:2.0:1783349927.321893:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 166 00000100:00100000:2.0:1783349927.321903:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+40:12214:x1869977642676608:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:2.0:1783349927.321970:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.321987:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.322027:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.322064:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.322072:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.322080:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.322086:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349927.322090:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.322097:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.322110:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349927.322113:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349927.322118:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.322124:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349927.322418:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+40:12214:x1869977642676608:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 515us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349927.322426:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 166 00000100:00100000:1.0:1783349927.325617:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349927.325721:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642676864 00000100:00100000:0.0:1783349927.325731:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642676864 00000100:00100000:0.0:1783349927.325824:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:0.0:1783349927.325834:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+40:12214:x1869977642676864:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:0.0:1783349927.326459:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+41:12214:x1869977642676864:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 625us (849us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1783349927.326469:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:1.0:1783349927.534067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349927.535589:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642677120 00000100:00100000:2.0:1783349927.535603:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642677120 00000100:00100000:2.0:1783349927.535674:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 167 00000100:00100000:2.0:1783349927.535685:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+41:12245:x1869977642677120:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:2.0:1783349927.535710:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349927.535729:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0c4 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.535832:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2bba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.535846:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2bba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.535856:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2bba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349927.535868:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783349927.535977:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2bb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0c4 expref: 44 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.535997:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2bba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0c4 expref: 43 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.536401:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349927.536406:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349927.536410:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6400, rc 0) 00000100:00100000:2.0:1783349927.536478:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+43:12245:x1869977642677120:12345-192.168.203.50@tcp:101:cat.0 Request processed in 794us (2420us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1783349927.536502:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 167 00000100:00100000:2.0:1783349927.553020:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349927.553054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349927.553176:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642677504 00000100:00100000:1.0:1783349927.553187:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642677504 00000100:00100000:1.0:1783349927.553252:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:1.0:1783349927.553262:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+43:12245:x1869977642677504:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:1.0:1783349927.553531:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+44:12245:x1869977642677504:12345-192.168.203.50@tcp:35:cat.0 Request processed in 271us (475us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1783349927.553538:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:0.0:1783349927.561408:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642677248 00000100:00100000:0.0:1783349927.561422:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642677248 00000100:00100000:0.0:1783349927.561494:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:0.0:1783349927.561503:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea35094b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+44:2399:x1869977642677248:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349927.561518:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349927.561542:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2bba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0c4 expref: 44 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.561561:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:0.0:1783349927.561577:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349927.561648:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea35094b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+43:2399:x1869977642677248:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 145us (8636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349927.561657:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:2.0:1783349927.660005:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349927.660110:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642677760 00000100:00100000:0.0:1783349927.660120:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642677760 00000100:00100000:0.0:1783349927.660217:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 168 00000100:00100000:0.0:1783349927.660437:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+43:12251:x1869977642677760:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:0.0:1783349927.660462:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349927.660465:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783349927.660488:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2b20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded09a expref: 43 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.660524:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:0.0:1783349927.660529:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349927.660542:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2bc8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0cb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.660715:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.660728:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0bd expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.660735:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.660763:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0bd expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.660776:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0bd expref: 43 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349927.660790:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659512448:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349927.660874:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea341377e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349927.669379:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659512448:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349927.669416:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349927.680973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349927.682031:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642677888 00000100:00100000:0.0:1783349927.682054:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642677888 00010000:00010000:0.0:1783349927.682091:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0bd expref: 44 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349927.682125:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 84 00000100:00100000:0.0:1783349927.682171:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+44:2399:x1869977642677888:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349927.682186:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349927.682192:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0bd expref: 44 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.682214:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0bd expref: 44 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.682233:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2b9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0bd expref: 44 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.682249:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:0.0:1783349927.682253:0:13183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.682262:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.682268:0:13183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349927.682297:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349927.682633:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+43:2399:x1869977642677888:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 498us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349927.682648:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 84 00010000:00010000:2.0:1783349927.685168:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.685183:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349927.685203:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783349927.686236:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349927.686307:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2bc8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0cb expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.686339:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0cb expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.686357:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349927.686359:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783349927.686362:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a400, rc 0) 00000100:00100000:2.0:1783349927.686423:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+43:12251:x1869977642677760:12345-192.168.203.50@tcp:101:dd.0 Request processed in 26197us (26426us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1783349927.686430:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 168 00000100:00100000:2.0:1783349927.691397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349927.691481:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642678016 00000100:00100000:1.0:1783349927.691491:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642678016 00000100:00100000:1.0:1783349927.691553:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 169 00000100:00100000:1.0:1783349927.691562:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+43:12251:x1869977642678016:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:1.0:1783349927.691583:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349927.691601:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2bdd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0d2 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.691629:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.691642:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.691652:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.691757:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2bdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d2 expref: 45 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.691773:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d2 expref: 44 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.691781:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:1.0:1783349927.691784:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783349927.691787:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8ce00, rc 0) 00000100:00100000:1.0:1783349927.691834:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+44:12251:x1869977642678016:12345-192.168.203.50@tcp:101:dd.0 Request processed in 273us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349927.691840:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 169 00000100:00100000:1.0:1783349927.696990:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349927.698190:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642678272 00000100:00100000:2.0:1783349927.698215:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642678272 00000100:00100000:2.0:1783349927.698282:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 170 00000100:00100000:2.0:1783349927.698302:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+44:12251:x1869977642678272:12345-192.168.203.50@tcp:36:dd.0 00010000:00010000:2.0:1783349927.706479:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.706503:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.706771:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349927.706835:0:8582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1783349927.706869:0:8582:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000321827cc reply state 000000009f68a72e transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.706882:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.706889:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349927.706892:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783349927.706896:0:8582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349927.707215:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+47:12251:x1869977642678272:12345-192.168.203.50@tcp:36:dd.0 Request processed in 8899us (10225us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1783349927.707226:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 170 00000020:00080000:2.0:1783349927.707232:0:8582:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783349927.976182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349927.976291:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642678400 00000100:00100000:2.0:1783349927.976301:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642678400 00000100:00100000:2.0:1783349927.976373:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 171 00000100:00100000:2.0:1783349927.976384:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+47:12265:x1869977642678400:12345-192.168.203.50@tcp:101:stat.0 00010000:00010000:2.0:1783349927.976407:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349927.976427:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2bf2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0d9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976510:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2bf9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976524:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976535:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976546:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976554:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976561:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976650:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976661:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0cb expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976670:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976704:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0cb expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349927.976729:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0cb expref: 48 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349927.976743:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659512576:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349927.976846:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349927.980080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349927.980197:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659512576:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783349927.980240:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349927.980531:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642678656 00000100:00100000:3.0:1783349927.980539:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642678656 00000100:00100000:3.0:1783349927.980606:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:3.0:1783349927.980617:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+49:6631:x1869977642678656:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783349927.980904:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+50:6631:x1869977642678656:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 288us (832us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1783349927.980913:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:0.0:1783349927.983558:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349927.983662:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642678784 00000100:00100000:3.0:1783349927.983672:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642678784 00010000:00010000:3.0:1783349927.983707:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0cb expref: 50 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349927.983749:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 85 00000100:00100000:3.0:1783349927.983758:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+50:2400:x1869977642678784:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349927.983774:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349927.983780:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0cb expref: 50 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349927.983793:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0cb expref: 50 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349927.983833:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2bcf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0cb expref: 50 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349927.983851:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349927.983856:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349927.983866:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349927.983874:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349927.983902:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349927.983943:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+49:2400:x1869977642678784:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 185us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349927.983950:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 85 00010000:00010000:1.0:1783349927.984255:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984266:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349927.984314:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783349927.984319:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783349927.984361:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984374:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984384:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984396:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984403:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984409:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349927.984413:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984420:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984428:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:1.0:1783349927.984431:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349927.984435:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2bf9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984441:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2bf9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984451:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984457:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984463:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984468:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349927.984476:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984482:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984490:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea2424c5100) 00010000:00010000:1.0:1783349927.984492:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349927.984494:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984499:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984527:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2bf2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d9 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984538:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d9 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349927.984544:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:1.0:1783349927.984545:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349927.984547:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7a00, rc 0) 00000100:00100000:1.0:1783349927.984579:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+48:12265:x1869977642678400:12345-192.168.203.50@tcp:101:stat.0 Request processed in 8198us (8407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349927.984586:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 171 00000100:00100000:0.0:1783349928.058906:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.059102:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642679040 00000100:00100000:2.0:1783349928.059245:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642679040 00000100:00100000:2.0:1783349928.059309:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 172 00000100:00100000:2.0:1783349928.059319:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+48:12271:x1869977642679040:12345-192.168.203.50@tcp:36:truncate.0 00010000:00010000:2.0:1783349928.059390:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349928.059416:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d9 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.059435:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349928.059440:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349928.059819:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.059834:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.059844:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349928.059897:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1783349928.059918:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c7657cf reply state 000000005c748d06 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.059931:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.059938:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349928.059940:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783349928.059943:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349928.060559:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+50:12271:x1869977642679040:12345-192.168.203.50@tcp:36:truncate.0 Request processed in 1239us (1660us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1783349928.060577:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 172 00000020:00080000:2.0:1783349928.060583:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783349928.206279:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.206451:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642679168 00000100:00100000:2.0:1783349928.206462:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642679168 00000100:00100000:2.0:1783349928.206526:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 173 00000100:00100000:2.0:1783349928.206535:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+50:12285:x1869977642679168:12345-192.168.203.50@tcp:101:stat.0 00010000:00010000:2.0:1783349928.206559:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349928.206587:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0e0 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206658:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206672:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206684:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206709:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206716:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206723:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206789:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206799:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206806:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349928.206844:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1783349928.206848:0:8582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349928.206868:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206880:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206888:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206895:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206912:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206918:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349928.206922:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206929:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206941:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349928.206944:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349928.206948:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206955:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206968:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206974:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206981:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.206985:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349928.206988:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.207005:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.207013:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea2424c5100) 00010000:00010000:2.0:1783349928.207015:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349928.207018:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.207023:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.207050:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e0 expref: 52 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.207063:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e0 expref: 51 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.207071:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349928.207073:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349928.207076:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7c00, rc 0) 00000100:00100000:2.0:1783349928.207267:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+51:12285:x1869977642679168:12345-192.168.203.50@tcp:101:stat.0 Request processed in 731us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349928.207275:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 173 00000100:00100000:1.0:1783349928.345521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.345676:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642679424 00000100:00100000:2.0:1783349928.345685:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642679424 00000100:00100000:2.0:1783349928.345846:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 174 00000100:00100000:2.0:1783349928.345858:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+51:12295:x1869977642679424:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349928.345894:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349928.345914:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0e7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349928.346008:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783349928.346131:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e7 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.346181:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5d00) 00010000:00010000:2.0:1783349928.346185:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349928.346190:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e7 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.346205:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7a00, rc 0) 00000100:00100000:2.0:1783349928.346492:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+52:12295:x1869977642679424:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 636us (979us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1783349928.346500:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 174 00000001:00080000:0.0:1783349928.351068:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000004:00080000:0.0:1783349928.351329:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1783349928.351357:0:6496:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ea243963b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1783349928.351363:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36dbe6c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ea243963540 00000020:00080000:0.0:1783349928.351366:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36dbe6500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ea243a61c00 00010000:00010000:3.0:1783349928.351733:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351745:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351754:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351761:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ca00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349928.351766:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351790:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351806:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ea24311df00) 00010000:00010000:3.0:1783349928.351810:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349928.351814:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351821:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2a9b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351853:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351860:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351866:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351872:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349928.351875:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351881:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351890:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:3.0:1783349928.351892:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349928.351896:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351909:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2aa2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351926:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351946:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351953:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351958:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349928.351961:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351968:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351976:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea2424c5100) 00010000:00010000:3.0:1783349928.351979:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349928.351982:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.351988:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e2ae1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352005:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352228:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352242:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352247:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349928.352251:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352258:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352267:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349928.352270:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349928.352273:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352279:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2beb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352292:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352298:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352304:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352308:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349928.352311:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352417:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352426:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349928.352428:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349928.352431:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.352436:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2c0e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783349928.352458:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1783349928.352528:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1783349928.352833:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349928.352857:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659512704:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783349928.352957:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349928.353224:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659512704 00000100:00100000:1.0:1783349928.353232:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659512704 00000100:00100000:1.0:1783349928.353292:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783349928.353302:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659512704:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1783349928.353698:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1783349928.353866:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1783349928.353905:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a4bc2a5, atime: 0x6a4bc2a6, ctime: 0x6a4bc2a5, blocks: 0x8 00010000:00010000:1.0:1783349928.353913:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbbfe0ff/0xd05e6ae1590e2c3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.354288:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1783349928.354295:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349928.354302:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbfe0ff/0xd05e6ae1590e2c3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.354399:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbbfe0ff/0xd05e6ae1590e2c3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.354413:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbbfe0ff/0xd05e6ae1590e2c3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.354423:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbbfe0ff/0xd05e6ae1590e2c3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.354443:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783349928.354725:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349928.354733:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbbfe0ff/0xd05e6ae1590e2c3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349928.354742:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8cc00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783349928.354747:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbbfe0ff/0xd05e6ae1590e2c3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349928.354756:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbbfe0ff/0xd05e6ae1590e2c3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349928.354773:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbbfe0ff/0xd05e6ae1590e2c3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349928.354781:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbbfe0ff/0xd05e6ae1590e2c3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349928.354824:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349928.354826:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349928.354828:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349928.354979:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659512704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1676us (2020us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783349928.354998:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000004:00080000:2.0:1783349928.357439:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea243144000/2, rc 0, transno 4294967308 00000100:00100000:2.0:1783349928.357455:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659512704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783349928.361130:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349928.361331:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642679680 00000100:00100000:3.0:1783349928.361355:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642679680 00000100:00100000:3.0:1783349928.361414:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:3.0:1783349928.361425:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fc9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+17:12295:x1869977642679680:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1783349928.361686:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fc9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+18:12295:x1869977642679680:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 262us (570us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1783349928.361694:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:1.0:1783349928.440654:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.440807:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642679936 00000100:00100000:2.0:1783349928.440816:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642679936 00000100:00100000:2.0:1783349928.440882:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 175 00000100:00100000:2.0:1783349928.440893:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+18:12301:x1869977642679936:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783349928.440916:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349928.440950:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c46 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.441097:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.441470:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e0 expref: 19 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.441479:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.441513:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e0 expref: 19 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.441526:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e0 expref: 19 pid: 8582 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349928.441540:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1869977659512832:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349928.441641:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963240 going to sleep for 11 seconds 00000100:00100000:1.0:1783349928.445958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349928.446554:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642680064 00000100:00100000:3.0:1783349928.446573:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642680064 00010000:00010000:3.0:1783349928.446612:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e0 expref: 20 pid: 8582 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349928.446740:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1869977659512832:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783349928.446763:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349928.446791:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00100000:3.0:1783349928.446801:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+20:2399:x1869977642680064:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349928.446832:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349928.446839:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e0 expref: 20 pid: 8582 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.446851:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e0 expref: 20 pid: 8582 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.446873:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2c2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0e0 expref: 20 pid: 8582 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.446888:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349928.446891:0:7459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.446901:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.446908:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.446944:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349928.446999:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+19:2399:x1869977642680064:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 199us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349928.447016:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 86 00010000:00010000:2.0:1783349928.447068:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.447076:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349928.447093:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1783349928.447784:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0ee expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.447802:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0ee expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.447809:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349928.447812:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783349928.447814:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6800, rc 0) 00000100:00100000:2.0:1783349928.447959:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+19:12301:x1869977642679936:12345-192.168.203.50@tcp:101:bash.0 Request processed in 7067us (7313us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1783349928.447967:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 175 00000100:00100000:1.0:1783349928.453527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.453618:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642680320 00000100:00100000:2.0:1783349928.453637:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642680320 00000100:00100000:2.0:1783349928.453700:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 176 00000100:00100000:2.0:1783349928.453711:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+19:12301:x1869977642680320:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:2.0:1783349928.453946:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.453963:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.453975:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349928.454015:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1783349928.454038:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004e1979a reply state 00000000bc2e449b transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.454050:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.454072:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349928.454075:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783349928.454078:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349928.454199:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+22:12301:x1869977642680320:12345-192.168.203.50@tcp:36:bash.0 Request processed in 490us (681us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1783349928.454207:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 176 00000020:00080000:2.0:1783349928.454211:0:12147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783349928.460855:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.460959:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642680448 00000100:00100000:2.0:1783349928.460968:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642680448 00000100:00100000:2.0:1783349928.461033:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 177 00000100:00100000:2.0:1783349928.461043:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+22:12301:x1869977642680448:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783349928.461067:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349928.461085:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0f5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.461690:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.461706:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0ee expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.461715:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.461748:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0ee expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.461762:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0ee expref: 23 pid: 6518 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349928.461784:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659512960:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349928.462155:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349928.466396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349928.466783:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642680576 00000100:00100000:1.0:1783349928.466792:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642680576 00010000:00010000:1.0:1783349928.466829:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0ee expref: 24 pid: 6518 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349928.466867:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 87 00000100:00100000:1.0:1783349928.466876:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+24:2399:x1869977642680576:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349928.466891:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349928.466897:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0ee expref: 24 pid: 6518 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.466910:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0ee expref: 24 pid: 6518 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.466944:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:1.0:1783349928.466950:0:13183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.466961:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.466968:0:13183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.467005:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349928.467292:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+24:2399:x1869977642680576:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 415us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349928.467301:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 87 00010000:00010000:2.0:1783349928.467469:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0ee expref: 23 pid: 6518 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349928.467486:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243a19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659512960:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783349928.467507:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.467516:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.467522:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349928.467582:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783349928.467586:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349928.467607:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.467784:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0f5 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.467799:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0f5 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.467807:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349928.467819:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349928.467822:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7800, rc 0) 00000100:00100000:2.0:1783349928.467852:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+22:12301:x1869977642680448:12345-192.168.203.50@tcp:101:bash.0 Request processed in 6811us (7006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349928.467859:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 177 00000100:00100000:1.0:1783349928.472539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349928.472762:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642680832 00000100:00100000:3.0:1783349928.472772:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642680832 00000100:00100000:3.0:1783349928.472870:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:3.0:1783349928.472880:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+22:12301:x1869977642680832:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:3.0:1783349928.473337:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+23:12301:x1869977642680832:12345-192.168.203.50@tcp:35:bash.0 Request processed in 445us (794us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1783349928.473356:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:0.0:1783349928.589778:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.589874:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642681088 00000100:00100000:2.0:1783349928.589884:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642681088 00000100:00100000:2.0:1783349928.589955:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 178 00000100:00100000:2.0:1783349928.589966:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+23:12311:x1869977642681088:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349928.589990:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349928.590020:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded0fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349928.590357:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783349928.590453:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0fc expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.590472:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5d00) 00010000:00010000:2.0:1783349928.590475:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349928.590480:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0fc expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.590494:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6e00, rc 0) 00000100:00100000:2.0:1783349928.590735:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+24:12311:x1869977642681088:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 769us (964us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1783349928.590747:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 178 00000100:00100000:0.0:1783349928.594329:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349928.594414:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642681216 00000100:00100000:3.0:1783349928.594423:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642681216 00000100:00100000:3.0:1783349928.594481:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 179 00000100:00100000:3.0:1783349928.594491:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+24:12311:x1869977642681216:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:3.0:1783349928.594559:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2c7e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594584:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2c7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594596:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2c7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594611:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2c85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594618:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594625:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594722:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594731:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594760:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349928.594813:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594826:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2c7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594832:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2c7e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594839:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2c7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594845:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349928.594849:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2c7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594856:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2c7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594868:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:3.0:1783349928.594871:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349928.594875:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2c7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594882:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2c7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594896:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594908:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2c85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594914:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2c85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.594925:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349928.595379:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2c85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.595389:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2c85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.595398:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea36d07f000) 00010000:00010000:3.0:1783349928.595401:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349928.595404:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2c85 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.595410:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2c85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.595426:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.595432:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.595439:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.595444:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349928.595453:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.595464:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.595473:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349928.595476:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349928.595479:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.595484:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2c8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349928.595556:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+24:12311:x1869977642681216:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 1065us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349928.595640:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 179 00000100:00100000:3.0:1783349928.598702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.598790:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642681472 00000100:00100000:2.0:1783349928.598816:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642681472 00000100:00100000:2.0:1783349928.598871:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:2.0:1783349928.598881:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+24:12311:x1869977642681472:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349928.599131:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+25:12311:x1869977642681472:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 251us (442us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1783349928.599479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:0.0:1783349928.644218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.644313:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642681728 00000100:00100000:2.0:1783349928.644336:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642681728 00000100:00100000:2.0:1783349928.644405:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 180 00000100:00100000:2.0:1783349928.644415:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+25:12314:x1869977642681728:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349928.644440:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349928.644462:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded103 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644548:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c9a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644564:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644576:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644590:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2ca1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644598:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644605:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644715:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2ca8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644725:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644732:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349928.644741:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783349928.644814:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644822:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c9a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644828:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644834:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349928.644838:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644845:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c9a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644857:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349928.644860:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349928.644864:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644880:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2c9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644893:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644899:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644904:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644908:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349928.644911:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644916:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644922:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea2424c5c00) 00010000:00010000:2.0:1783349928.644925:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349928.644927:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2ca1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644932:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2ca1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644970:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2c93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded103 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644981:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded103 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.644993:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349928.644996:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349928.644998:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7000, rc 0) 00000100:00100000:2.0:1783349928.645223:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+27:12314:x1869977642681728:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 809us (1012us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1783349928.645231:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 180 00000100:00100000:0.0:1783349928.649807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349928.649852:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.649927:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642681984 00000100:00100000:2.0:1783349928.649937:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642681984 00000100:00100000:2.0:1783349928.650000:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 181 00000100:00100000:2.0:1783349928.650024:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+27:12314:x1869977642681984:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:2.0:1783349928.650088:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.650105:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.650116:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.650178:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.650185:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.650191:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.650198:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349928.650214:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.650222:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.650233:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349928.650237:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349928.650241:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349928.650248:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349928.650307:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+27:12314:x1869977642681984:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 298us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349928.650315:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 181 00000100:00100000:1.0:1783349928.650845:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642681856 00000100:00100000:1.0:1783349928.650851:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642681856 00000100:00100000:1.0:1783349928.650898:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:1.0:1783349928.650907:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+27:2399:x1869977642681856:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349928.650934:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349928.650950:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2ca8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded103 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349928.650963:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:1.0:1783349928.650966:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349928.650989:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+26:2399:x1869977642681856:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 84us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349928.650996:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:3.0:1783349928.653813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349928.653891:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642682240 00000100:00100000:2.0:1783349928.653900:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642682240 00000100:00100000:2.0:1783349928.653957:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:2.0:1783349928.653967:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+26:12314:x1869977642682240:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349928.654216:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+27:12314:x1869977642682240:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 250us (410us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1783349928.654224:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00010000:00010000:3.0:1783349928.708479:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349928.837697:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659513216:0@lo:400:kworker.0 00000100:00100000:2.0:1783349928.837723:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659513088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349928.837768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349928.837774:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349928.838102:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659513728:0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.838157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349928.838176:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659514240:0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.838211:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349928.838231:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783349928.838236:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659513344:0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.838253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349928.838280:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659513856:0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.838298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349928.838310:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659514368:0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.838548:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349928.838632:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659513216 00000100:00100000:3.0:1783349928.838639:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659513216 00000100:00100000:3.0:1783349928.838680:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1783349928.838687:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659513216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.838734:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659513216:12345-0@lo:400:kworker.0 Request processed in 48us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349928.838741:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1783349928.838791:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659514752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349928.838947:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659513728 00000100:00100000:3.0:1783349928.838951:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659513728 00000100:00100000:3.0:1783349928.839036:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783349928.839043:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24452ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659513728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.839157:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659513472:0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.839195:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349928.839217:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659513984:0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.839241:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349928.839260:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24452ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659513728:12345-0@lo:400:kworker.0 Request processed in 215us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349928.839267:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659514496:0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.839269:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783349928.839283:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659513472 00000100:00100000:3.0:1783349928.839288:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659513472 00000100:00100000:0.0:1783349928.839299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349928.839306:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783349928.839314:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659513472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.839351:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659514880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349928.839377:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349928.839401:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659514880 00000100:00100000:0.0:1783349928.839406:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659514880 00000100:00100000:3.0:1783349928.839428:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659513472:12345-0@lo:400:kworker.0 Request processed in 113us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349928.839432:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783349928.839441:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783349928.839445:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659514880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783349928.839472:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783349928.839478:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659514240 00000100:00100000:3.0:1783349928.839483:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659514240 00000100:00100000:3.0:1783349928.839686:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659513344 00000100:00100000:3.0:1783349928.839690:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659513344 00000100:00100000:3.0:1783349928.839701:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659513856 00000100:00100000:3.0:1783349928.839703:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659513856 00000100:00100000:3.0:1783349928.839713:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659514368 00000100:00100000:3.0:1783349928.839715:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659514368 00000100:00100000:3.0:1783349928.839764:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659513984 00000100:00100000:3.0:1783349928.839766:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659513984 00000100:00100000:3.0:1783349928.839782:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1783349928.839787:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659514240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.839939:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659514240:12345-0@lo:400:kworker.0 Request processed in 93us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349928.839947:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1783349928.839960:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1783349928.839966:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659513344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.840056:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659513344:12345-0@lo:400:kworker.0 Request processed in 91us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349928.840061:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1783349928.840073:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1783349928.840078:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659513856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.840099:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659513856:12345-0@lo:400:kworker.0 Request processed in 21us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349928.840104:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1783349928.840112:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783349928.840117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659514368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.840156:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659514368:12345-0@lo:400:kworker.0 Request processed in 38us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349928.840168:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783349928.840245:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1783349928.840252:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659513984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349928.840279:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659513984:12345-0@lo:400:kworker.0 Request processed in 29us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349928.840284:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1783349928.844878:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659513600:0@lo:400:kworker.0 00000100:00100000:2.0:1783349928.844937:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349928.844973:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36db7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659514112:0@lo:400:kworker.0 00000100:00100000:2.0:1783349928.844995:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349928.856848:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659514880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 17396us (17460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349928.856878:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1783349928.856924:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349928.856928:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349928.856978:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659514880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349928.857015:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659513472:0@lo:400:kworker.0 00010000:00080000:0.0:1783349928.857028:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36db7ce00 x1869977659513984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349928.857038:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659513984:0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.857069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349928.857114:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659513344:0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.857125:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659513856:0@lo:400:kworker.0 00010000:00080000:0.0:1783349928.857152:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2438eaa00 x1869977659514368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349928.857164:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659514368:0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.857176:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659513216:0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.857184:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659513728:0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.857197:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659514240:0@lo:400:kworker.0 00000100:00100000:2.0:1783349928.857223:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659514624:0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.857239:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659514496 00000100:00100000:0.0:1783349928.857247:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659514496 00000100:00100000:2.0:1783349928.857276:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349928.857303:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659514112 00000100:00100000:0.0:1783349928.857308:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659514112 00000100:00100000:2.0:1783349928.857335:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659514624 00000100:00100000:2.0:1783349928.857348:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659514624 00000100:00100000:0.0:1783349928.857353:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783349928.857372:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659514496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349928.857384:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783349928.857393:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659514112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.857434:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659514496:12345-0@lo:400:kworker.0 Request processed in 65us (18134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349928.857441:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659514112:12345-0@lo:400:kworker.0 Request processed in 48us (12442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349928.857445:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783349928.857454:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783349928.857462:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783349928.857469:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659514624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349928.857486:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36db7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659514112:0@lo:400:kworker.0 00000100:00100000:0.0:1783349928.857498:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659514624:12345-0@lo:400:kworker.0 Request processed in 30us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349928.857503:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783349928.857516:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659514624:0@lo:400:kworker.0 00000100:00080000:0.0:1783349928.857526:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349928.857531:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349928.857565:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659514496:0@lo:400:kworker.0 00000100:00100000:2.0:1783349928.857581:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659513600 00000100:00100000:2.0:1783349928.857586:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659513600 00000100:00100000:2.0:1783349928.857607:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783349928.857613:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659513600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349928.857648:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659513600:12345-0@lo:400:kworker.0 Request processed in 34us (12710us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349928.857654:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1783349928.857682:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659513600:0@lo:400:kworker.0 00000100:00100000:1.0:1783349928.857736:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659513088 00000100:00100000:1.0:1783349928.857742:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659513088 00000100:00100000:1.0:1783349928.857769:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659514752 00000100:00100000:1.0:1783349928.857773:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659514752 00000100:00100000:1.0:1783349928.857786:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783349928.857792:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659513088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349928.857796:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783349928.857802:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659514752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783349928.857812:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00002000:00000024:0.0:1783349928.857812:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783349928.857845:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659514752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349928.857852:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783349928.857899:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659514752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349928.857922:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659513088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (20151us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349928.857930:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659513088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349928.857935:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783349928.999232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349928.999318:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642682496 00000100:00100000:3.0:1783349928.999327:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642682496 00000100:00100000:3.0:1783349928.999395:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 182 00000100:00100000:3.0:1783349928.999405:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+27:12332:x1869977642682496:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:3.0:1783349928.999428:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349928.999448:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2cbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded10a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.999547:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2cc4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.999562:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.999580:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349928.999596:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783349928.999847:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2cbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded10a expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.999865:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded10a expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349928.999945:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349928.999949:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783349928.999952:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030a00, rc 0) 00000100:00100000:3.0:1783349929.000085:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+29:12332:x1869977642682496:12345-192.168.203.50@tcp:101:cat.0 Request processed in 680us (861us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1783349929.000092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 182 00000100:00100000:0.0:1783349929.044053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349929.046488:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642682624 00000100:00100000:2.0:1783349929.046502:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642682624 00000100:00100000:2.0:1783349929.047817:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 183 00000100:00100000:2.0:1783349929.047847:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+29:12333:x1869977642682624:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349929.047870:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349929.047890:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded111 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349929.047955:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2cd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349929.047969:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349929.047980:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349929.048022:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783349929.048026:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349929.048045:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349929.048070:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2cd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded111 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349929.048088:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded111 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349929.048097:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349929.048100:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349929.048104:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6200, rc 0) 00000100:00100000:2.0:1783349929.048203:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+30:12333:x1869977642682624:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 361us (4159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349929.048221:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 183 00000100:00080000:0.0:1783349929.049047:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349929.055420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349929.056917:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642683008 00000100:00100000:2.0:1783349929.056931:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642683008 00000100:00100000:2.0:1783349929.057158:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:2.0:1783349929.057170:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+30:12333:x1869977642683008:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349929.059767:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+31:12333:x1869977642683008:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 2590us (4348us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1783349929.059780:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:1.0:1783349929.068254:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349929.068360:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642683136 00000100:00100000:3.0:1783349929.068370:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642683136 00000100:00100000:3.0:1783349929.068439:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:3.0:1783349929.068450:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+31:12333:x1869977642683136:12345-192.168.203.50@tcp:103:lfs.0 00010000:00010000:3.0:1783349929.068466:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783349929.068489:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e2c69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0f5 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349929.068511:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2cc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded10a expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349929.068526:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2b5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0af expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349929.068536:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349929.068541:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349929.068974:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+28:12333:x1869977642683136:12345-192.168.203.50@tcp:103:lfs.0 Request processed in 523us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349929.068983:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:0.0:1783349929.072773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349929.081376:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642683264 00000100:00100000:3.0:1783349929.081391:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642683264 00000100:00100000:3.0:1783349929.082019:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 184 00000100:00100000:3.0:1783349929.082032:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+28:12333:x1869977642683264:12345-192.168.203.50@tcp:58:lfs.0 00010000:00010000:3.0:1783349929.082487:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ce0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349929.082507:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ce0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349929.082521:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ce0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783349929.082614:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1783349929.083764:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+28:12333:x1869977642683264:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 1730us (10996us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349929.083773:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 184 00000100:00100000:1.0:1783349929.154648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349929.155042:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642683392 00000100:00100000:0.0:1783349929.155051:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642683392 00000100:00100000:0.0:1783349929.155115:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 185 00000100:00100000:0.0:1783349929.155178:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+28:12335:x1869977642683392:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349929.155202:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349929.155222:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2ce7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded118 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155291:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2cee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155308:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2cee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155318:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2cee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155331:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2cf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155347:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155359:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155436:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155450:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155456:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349929.155509:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783349929.155513:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783349929.155531:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155545:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155553:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2cee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155558:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2cee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155568:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2cee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155573:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364ba00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349929.155577:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2cee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155583:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2cee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155593:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:0.0:1783349929.155595:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349929.155602:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2cee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155872:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e2cee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155898:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155904:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155909:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155917:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349929.155920:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155926:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155933:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea349e98a00) 00010000:00010000:0.0:1783349929.155935:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349929.155941:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2cf5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155947:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2cf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155975:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364aa00/0xd05e6ae1590e2ce7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded118 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.155990:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded118 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349929.156006:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:0.0:1783349929.156008:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349929.156011:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b200, rc 0) 00000100:00100000:0.0:1783349929.156131:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+29:12335:x1869977642683392:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 995us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349929.156169:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 185 00010000:00010000:3.0:1783349929.732793:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783349930.052298:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349930.052319:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349930.052359:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1783349930.052368:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349930.052512:0:13790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243b2d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659515008:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783349930.052802:0:13790:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349930.054919:0:13790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243b2d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659515008:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783349930.055637:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.055711:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642683520 00000100:00100000:3.0:1783349930.055718:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642683520 00000100:00100000:3.0:1783349930.055770:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 186 00000100:00100000:3.0:1783349930.055780:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+29:12346:x1869977642683520:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783349930.055822:0:8582:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783349930.055942:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+29:12346:x1869977642683520:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 155us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.055949:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 186 00000100:00100000:1.0:1783349930.058989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.059168:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642683648 00000100:00100000:3.0:1783349930.059178:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642683648 00000100:00100000:3.0:1783349930.059235:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 187 00000100:00100000:3.0:1783349930.059246:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+29:12346:x1869977642683648:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783349930.059435:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d03 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.059463:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.059475:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.059978:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.059990:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.059997:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.060032:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.060042:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.060063:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349930.060108:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783349930.060112:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349930.060124:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061047:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061058:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d03 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061066:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061072:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349930.061076:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061083:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d03 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061096:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:3.0:1783349930.061100:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349930.061104:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061172:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061179:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d0a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061186:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061191:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349930.061194:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061200:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d0a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061209:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8ea36d07f000) 00010000:00010000:3.0:1783349930.061211:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349930.061214:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d0a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061220:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d0a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061238:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061243:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061249:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061260:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349930.061263:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061269:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061277:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349930.061279:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349930.061282:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.061287:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349930.061728:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+29:12346:x1869977642683648:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 2478us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349930.061739:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 187 00000100:00100000:0.0:1783349930.067648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349930.067797:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642683904 00000100:00100000:2.0:1783349930.067807:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642683904 00000100:00100000:2.0:1783349930.067868:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 188 00000100:00100000:2.0:1783349930.067878:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+29:12346:x1869977642683904:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349930.067898:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349930.067918:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded11f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068105:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068119:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068130:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349930.068190:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783349930.068264:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068273:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068279:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068285:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349930.068289:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068297:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068309:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:2.0:1783349930.068312:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349930.068316:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068323:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068894:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d18 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded11f expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068906:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:2.0:1783349930.068908:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349930.068921:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded11f expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.068932:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6e00, rc 0) 00000100:00100000:2.0:1783349930.069600:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+30:12346:x1869977642683904:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 1720us (1956us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1783349930.069609:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 188 00000100:00100000:0.0:1783349930.073233:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.073373:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642684032 00000100:00100000:3.0:1783349930.073383:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642684032 00000100:00100000:3.0:1783349930.073429:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 189 00000100:00100000:3.0:1783349930.073439:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+30:12346:x1869977642684032:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783349930.073487:0:8582:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783349930.073596:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+30:12346:x1869977642684032:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 158us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.073603:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 189 00000100:00100000:1.0:1783349930.078419:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349930.078599:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642684288 00000100:00100000:2.0:1783349930.078608:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642684288 00000100:00100000:2.0:1783349930.078664:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 190 00000100:00100000:2.0:1783349930.078674:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+30:12346:x1869977642684288:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349930.078693:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349930.078696:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783349930.078719:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2cd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded111 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.078736:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349930.078740:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349930.078750:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d2d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded126 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349930.079056:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1783349930.079212:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.079224:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.079234:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.079292:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded126 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.079306:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded126 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.079313:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea2424c5900) 00010000:00010000:2.0:1783349930.079315:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349930.079318:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6800, rc 0) 00000100:00100000:2.0:1783349930.080615:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+31:12346:x1869977642684288:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 1936us (2199us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1783349930.080626:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 190 00000100:00100000:1.0:1783349930.102222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349930.103587:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642684544 00000100:00100000:2.0:1783349930.103599:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642684544 00000100:00100000:2.0:1783349930.103668:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 191 00000100:00100000:2.0:1783349930.103680:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+31:12346:x1869977642684544:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783349930.103740:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349930.103766:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2d34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded126 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103783:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea2424c5900) 00010000:00010000:2.0:1783349930.103794:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349930.103812:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103825:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103842:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103898:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2d49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc50ac12b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103906:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2d49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc50ac12b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103913:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2d49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc50ac12b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103954:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103961:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d42 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103967:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103973:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349930.103978:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103985:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.103994:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349930.103997:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349930.104001:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d42 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.104421:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2d42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.104439:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2d49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc50ac12b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.104446:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2d49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc50ac12b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.104452:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2d49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc50ac12b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.104457:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349930.104461:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2d49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc50ac12b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.104467:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2d49 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc50ac12b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.104475:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc50ac12b (ffff8ea2424c5400) 00010000:00010000:2.0:1783349930.104485:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349930.104488:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2d49 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc50ac12b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349930.104494:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2d49 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc50ac12b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349930.104769:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+30:12346:x1869977642684544:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 1089us (2552us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783349930.104777:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 191 00000100:00100000:2.0:1783349930.117806:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.123161:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642684672 00000100:00100000:3.0:1783349930.123174:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642684672 00000100:00100000:3.0:1783349930.123237:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 192 00000100:00100000:3.0:1783349930.123247:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+30:12346:x1869977642684672:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349930.123266:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349930.123301:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded12d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.123362:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.123374:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.123385:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.123745:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded12d expref: 32 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.123762:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded12d expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.123772:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:3.0:1783349930.123775:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783349930.123778:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030800, rc 0) 00000100:00100000:3.0:1783349930.123837:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+31:12346:x1869977642684672:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 592us (6040us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.123845:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 192 00000100:00100000:3.0:1783349930.128087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349930.128306:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642684928 00000100:00100000:0.0:1783349930.128335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642684928 00000100:00100000:0.0:1783349930.128393:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 193 00000100:00100000:0.0:1783349930.128404:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+31:12346:x1869977642684928:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783349930.128683:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.128701:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.128712:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783349930.128851:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1783349930.128860:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370923723012ns, next at 371923720699ns, rc = 0 00000004:00010000:0.0:1783349930.128898:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000220a7160 reply state 00000000f1948d85 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.128926:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.128934:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:0.0:1783349930.128937:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783349930.128941:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349930.129036:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+33:12346:x1869977642684928:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 633us (958us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1783349930.129044:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 193 00000100:00100000:3.0:1783349930.132407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349930.133668:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642685056 00000100:00100000:0.0:1783349930.133679:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642685056 00000100:00100000:0.0:1783349930.133733:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 194 00000100:00100000:0.0:1783349930.133741:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+33:12346:x1869977642685056:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349930.133761:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349930.133778:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2d65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded134 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.133824:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2d65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded134 expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.133836:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2d65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded134 expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.133852:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:0.0:1783349930.133854:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349930.133858:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364ae00, rc 0) 00000100:00100000:0.0:1783349930.133905:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+34:12346:x1869977642685056:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 166us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349930.133917:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 194 00000100:00100000:0.0:1783349930.139405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349930.139458:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642685184 00000100:00100000:0.0:1783349930.139469:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642685184 00000100:00100000:0.0:1783349930.139532:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:0.0:1783349930.139542:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642685184:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783349930.139756:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642685184:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 215us (360us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1783349930.139764:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00080000:0.0:1783349930.139788:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349930.151850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.151935:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642685440 00000100:00100000:3.0:1783349930.151945:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642685440 00000100:00100000:3.0:1783349930.152004:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:3.0:1783349930.152015:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+34:12346:x1869977642685440:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783349930.152269:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+35:12346:x1869977642685440:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 254us (426us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1783349930.152276:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:0.0:1783349930.158485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.158845:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642685696 00000100:00100000:3.0:1783349930.158863:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642685696 00000100:00100000:3.0:1783349930.159005:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 195 00000100:00100000:3.0:1783349930.159019:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+35:12346:x1869977642685696:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783349930.159240:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+35:12346:x1869977642685696:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 223us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.159249:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 195 00000100:00100000:0.0:1783349930.179385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.179474:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642685824 00000100:00100000:3.0:1783349930.179487:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642685824 00000100:00100000:3.0:1783349930.179562:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 196 00000100:00100000:3.0:1783349930.179574:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36db7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+35:12346:x1869977642685824:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349930.179602:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349930.179628:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded13b expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.179731:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.179748:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.179763:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349930.179840:0:8582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349930.179864:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.179893:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2d6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded13b expref: 37 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.179916:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded13b expref: 36 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.179926:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:3.0:1783349930.179929:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783349930.179933:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031c00, rc 0) 00000100:00100000:3.0:1783349930.180022:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36db7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+36:12346:x1869977642685824:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 451us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.180029:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 196 00000100:00100000:2.0:1783349930.191825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.191927:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642685952 00000100:00100000:3.0:1783349930.191940:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642685952 00000100:00100000:3.0:1783349930.192035:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:3.0:1783349930.192047:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642685952:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349930.192072:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349930.192098:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e2d7a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded142 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783349930.192163:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc2a9, blocks: 0x0 00010000:00010000:3.0:1783349930.192188:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1783349930.192201:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349930.192212:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e2d7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded142 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.192234:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e2d7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded142 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.192262:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031800, rc 0) 00000100:00100000:3.0:1783349930.192350:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+8:2402:x1869977642685952:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 296us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.192358:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:3.0:1783349930.201429:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349930.201564:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642686208 00000100:00100000:0.0:1783349930.201579:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642686208 00000100:00100000:0.0:1783349930.201657:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 197 00000100:00100000:0.0:1783349930.201669:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+36:12346:x1869977642686208:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783349930.201825:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+36:12346:x1869977642686208:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 157us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349930.201834:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 197 00000100:00100000:3.0:1783349930.209059:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349930.209183:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642686336 00000100:00100000:0.0:1783349930.209197:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642686336 00000100:00100000:0.0:1783349930.209271:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:0.0:1783349930.209283:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+8:12346:x1869977642686336:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349930.209309:0:9981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349930.209365:0:9981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded149 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.209410:0:9981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e2d7a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded142 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.209421:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783349930.209427:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349930.209433:0:9981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 9 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.209481:0:9981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e2d7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded142 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.209497:0:9981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e2d7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded142 expref: 9 pid: 8432 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349930.209514:0:9981:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9981:1869977659515136:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349930.209639:0:9981:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea346268000 going to sleep for 11 seconds 00000100:00100000:3.0:1783349930.217964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.218012:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642686464 00000100:00100000:3.0:1783349930.218024:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642686464 00010000:00010000:3.0:1783349930.218077:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e2d7a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded142 expref: 10 pid: 8432 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.218161:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:3.0:1783349930.218173:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea35094ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+10:2400:x1869977642686464:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349930.218194:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349930.218222:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e2d7a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded142 expref: 10 pid: 8432 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.218238:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e2d7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded142 expref: 10 pid: 8432 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.218294:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349930.218299:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349930.218310:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 10 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.218322:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 10 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.218766:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 10 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.218785:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1869977659515264:192.168.203.50@tcp:105: 00000100:00100000:3.0:1783349930.218889:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1783349930.219452:0:9981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e2d7a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded142 expref: 10 pid: 8432 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349930.219473:0:9981:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9981:1869977659515136:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349930.219504:0:9981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 9 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.219538:0:9981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a600, rc 0) 00000100:00100000:0.0:1783349930.219590:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+9:12346:x1869977642686336:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 10308us (10543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349930.219600:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:2.0:1783349930.240589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349930.240666:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1869977659515264:192.168.203.50@tcp:105: 00010000:00010000:2.0:1783349930.240698:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349930.240765:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea35094ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+8:2400:x1869977642686464:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 22593us (22814us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349930.240779:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:2.0:1783349930.240870:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642686592 00000100:00100000:2.0:1783349930.240879:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642686592 00002000:00100000:2.0:1783349930.240935:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ea24465f480 x1869977642686592/t0(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:681/0 lens 504/0 e 0 to 0 dl 1783349941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783349930.240947:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea24465f480 with x1869977642686592 ext(0->8) 00002000:00010000:2.0:1783349930.240952:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea24465f480 00000100:00100000:2.0:1783349930.240979:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:2.0:1783349930.240988:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642686592:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783349930.246869:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689af055-7605-419d-81ba-26cff8cb556b+10:2399:x1869977642686592:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 Request processed in 5864us (6277us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783349930.246887:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00002000:00100000:2.0:1783349930.246904:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ea24465f480 x1869977642686592/t4294967315(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:681/0 lens 504/448 e 0 to 0 dl 1783349941 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783349930.246916:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea24465f480 with x1869977642686592 ext(0->8) 00002000:00010000:2.0:1783349930.246925:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea24465f480 00000100:00100000:2.0:1783349930.259532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349930.260000:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642686720 00000100:00100000:1.0:1783349930.260014:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642686720 00000100:00100000:1.0:1783349930.260088:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 198 00000100:00100000:1.0:1783349930.260101:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+36:12346:x1869977642686720:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783349930.278708:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1783349930.278725:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1783349930.278761:0:6496:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1783349930.278782:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1783349930.278794:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1783349930.278896:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.278915:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.278924:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.278931:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349930.278937:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.278946:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.278973:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:1.0:1783349930.278976:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349930.278996:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.279004:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e2c5b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.279031:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.279038:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.279044:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.279050:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349930.279053:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.279060:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.279073:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:1.0:1783349930.279076:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783349930.279079:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349930.279085:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2d5e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.279167:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+19:12346:x1869977642686720:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 19037us (19618us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.279182:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 198 00000100:00100000:2.0:1783349930.281292:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349930.281343:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659515392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783349930.281407:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349930.281475:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659515392 00000100:00100000:2.0:1783349930.281482:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659515392 00000100:00100000:2.0:1783349930.281528:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783349930.281535:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659515392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783349930.281664:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783349930.281668:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783349929 00002000:00010000:2.0:1783349930.281671:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783349930.281673:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1783349929 -> 1783349929 00002000:00010000:2.0:1783349930.281676:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1783349930.281713:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659515392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (306us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783349930.281721:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1783349930.281744:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1783349930.281777:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea2439b5180/2, rc 0, transno 4294967316 00000100:00100000:2.0:1783349930.281783:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659515392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783349930.292070:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.293169:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642686848 00000100:00100000:3.0:1783349930.293183:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642686848 00000100:00100000:3.0:1783349930.293239:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:3.0:1783349930.293249:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2439b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+10:2400:x1869977642686848:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783349930.295127:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1783349930.295155:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1783349930.296605:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2439b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642686848:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 3348us (4534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.296690:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:3.0:1783349930.308811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349930.310092:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642687104 00000100:00100000:0.0:1783349930.310104:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642687104 00000100:00100000:0.0:1783349930.313227:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 199 00000100:00100000:0.0:1783349930.313244:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+19:12346:x1869977642687104:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783349930.313294:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349930.313992:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2d73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded13b expref: 19 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.314010:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:0.0:1783349930.314015:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349930.314045:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.314057:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.314275:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349930.314464:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008966b188 reply state 00000000279b3ab6 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.314487:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349930.314493:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:0.0:1783349930.314497:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783349930.314500:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349930.316072:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+20:12346:x1869977642687104:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 2819us (7254us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1783349930.316083:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 199 00000100:00100000:2.0:1783349930.381908:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659515520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349930.381977:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349930.382905:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783349930.382931:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659515648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349930.383436:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349930.383989:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659515520 00000100:00100000:1.0:1783349930.384007:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659515520 00000100:00100000:1.0:1783349930.384052:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659515648 00000100:00100000:1.0:1783349930.384055:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659515648 00000100:00100000:1.0:1783349930.384070:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783349930.384078:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659515520:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349930.384201:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00002000:00000024:1.0:1783349930.384371:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349930.384423:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659515520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 344us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349930.384429:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783349930.384473:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659515648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783349930.384484:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349930.384520:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659515648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 312us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349930.384532:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1783349930.384547:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349930.384583:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659515520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349930.392606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349930.392646:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642687232 00000100:00100000:2.0:1783349930.392655:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642687232 00000100:00100000:2.0:1783349930.392693:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:2.0:1783349930.392701:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+7:2399:x1869977642687232:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783349930.392834:0:9981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783349930.392838:0:9981:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1783349929 -> 1783349927 00002000:00010000:2.0:1783349930.392841:0:9981:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783349926 00002000:00010000:2.0:1783349930.392843:0:9981:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1783349929 -> 1783349927 00002000:00010000:2.0:1783349930.392845:0:9981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783349930.393027:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642687232:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 324us (483us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783349930.393035:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:1.0:1783349930.396073:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659515648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349930.598858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.598899:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.600625:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.600673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.635683:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642687616 00000100:00100000:3.0:1783349930.635700:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642687616 00000100:00100000:3.0:1783349930.635847:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:3.0:1783349930.635860:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642687616:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349930.635941:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642687616:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 83us (35324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.635967:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:3.0:1783349930.636002:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642687488 00000100:00100000:3.0:1783349930.636007:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642687488 00000100:00100000:3.0:1783349930.636046:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642687744 00000100:00100000:3.0:1783349930.636050:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642687744 00000100:00100000:3.0:1783349930.636105:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 299 00000100:00100000:3.0:1783349930.636115:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642687488:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349930.636185:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642687488:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 71us (37285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.636195:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 299 00000100:00100000:3.0:1783349930.636218:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 300 00000100:00100000:3.0:1783349930.636227:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642687744:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349930.636285:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642687744:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 59us (35613us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.636295:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 300 00000100:00100000:3.0:1783349930.636378:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.636473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.636568:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642688128 00000100:00100000:3.0:1783349930.636573:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642688128 00000100:00100000:3.0:1783349930.636604:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642687872 00000100:00100000:3.0:1783349930.636607:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642687872 00000100:00100000:3.0:1783349930.636628:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 301 00000100:00100000:3.0:1783349930.636638:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642687872:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349930.636675:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2401:x1869977642687872:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.636684:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 301 00000100:00100000:3.0:1783349930.636708:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 200 00000100:00100000:3.0:1783349930.636717:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+20:12346:x1869977642688128:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783349930.636785:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.636802:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded12d expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.636813:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.636845:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded12d expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.636873:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded12d expref: 20 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.636890:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659515776:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349930.636965:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359256900 going to sleep for 11 seconds 00000100:00080000:3.0:1783349930.638511:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783349930.638520:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349930.638524:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349930.650641:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.650837:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1869977659515776:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349930.650871:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.651241:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642688256 00000100:00100000:3.0:1783349930.651449:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642688256 00010000:00010000:3.0:1783349930.651487:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded12d expref: 21 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.651523:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 89 00000100:00100000:3.0:1783349930.651533:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244658380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+21:2399:x1869977642688256:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349930.651602:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349930.651610:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded12d expref: 21 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.651625:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded12d expref: 21 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.651759:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2d57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded12d expref: 21 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.651781:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:3.0:1783349930.651786:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.651795:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.651802:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.651824:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349930.651868:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244658380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+20:2399:x1869977642688256:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 336us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.651878:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 89 00010000:00010000:3.0:1783349930.651906:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.651914:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.652417:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.652425:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.652432:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.652447:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349930.652452:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.652462:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.652474:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:3.0:1783349930.652477:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783349930.652481:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.652486:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525c00/0xd05e6ae1590e2d8f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.652534:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+19:12346:x1869977642688128:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 Request processed in 15818us (16157us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783349930.652554:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 200 00000100:00100000:3.0:1783349930.658779:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.658829:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642688384 00000100:00100000:3.0:1783349930.658839:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642688384 00000100:00100000:3.0:1783349930.658895:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:3.0:1783349930.658908:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+8:2400:x1869977642688384:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783349930.663006:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.663042:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 8 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.663073:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349930.663078:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349930.663083:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.663126:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 8 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.663161:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 8 pid: 9981 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.663179:0:8433:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244659c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1869977659515904:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349930.665464:0:8433:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359256900 going to sleep for 11 seconds 00000100:00100000:3.0:1783349930.740240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.740541:0:8433:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244659c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1869977659515904:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349930.740582:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.740623:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642688512 00000100:00100000:3.0:1783349930.740630:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642688512 00010000:00010000:3.0:1783349930.740666:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 9 pid: 9981 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.740705:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:3.0:1783349930.740731:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642688512:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349930.740748:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349930.740770:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 9 pid: 9981 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.740787:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 9 pid: 9981 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.740811:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002429f534/0xd05e6ae1590e2d81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded149 expref: 9 pid: 9981 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.740830:0:7459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349930.740834:0:7459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349930.740840:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.740852:0:7459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.740878:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349930.741036:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642688512:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 306us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.741046:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 90 00010000:00010000:3.0:1783349930.742046:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.742060:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.742092:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.742101:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.742122:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.742671:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349930.742677:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.742688:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.742709:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.742718:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7ee4d19/0xd05e6ae1590e2d96 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.742804:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642688384:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 83896us (84861us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.742815:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:3.0:1783349930.745942:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.745984:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642688768 00000100:00100000:3.0:1783349930.745994:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642688768 00000100:00100000:3.0:1783349930.746054:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 201 00000100:00100000:3.0:1783349930.746067:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+19:12346:x1869977642688768:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783349930.746186:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.746204:0:12147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d2 expref: 19 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.746213:0:12147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.746538:0:12147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d2 expref: 19 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.746556:0:12147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d2 expref: 19 pid: 12147 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.746572:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244659f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659516032:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349930.746667:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359256900 going to sleep for 11 seconds 00000100:00100000:3.0:1783349930.749593:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.749659:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244659f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659516032:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349930.749703:0:12147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.751222:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642688896 00000100:00100000:3.0:1783349930.751248:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642688896 00010000:00010000:3.0:1783349930.751290:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d2 expref: 20 pid: 12147 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.751403:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:3.0:1783349930.751415:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244658700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+20:2400:x1869977642688896:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349930.751430:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349930.751437:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d2 expref: 20 pid: 12147 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.751452:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d2 expref: 20 pid: 12147 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.751476:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2be4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded0d2 expref: 20 pid: 12147 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.751498:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349930.751503:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.751513:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.751520:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.751559:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349930.751613:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244658700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+19:2400:x1869977642688896:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 200us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.751633:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 91 00010000:00010000:3.0:1783349930.751760:0:12147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.751769:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.752899:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.752976:0:12147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2d65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded134 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.752987:0:12147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.753242:0:12147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2d65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded134 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.753260:0:12147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2d65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded134 expref: 19 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.753277:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244659f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659516160:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349930.753441:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf900 going to sleep for 11 seconds 00000100:00100000:3.0:1783349930.756084:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.756126:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642689024 00000100:00100000:3.0:1783349930.756166:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642689024 00010000:00010000:3.0:1783349930.756206:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2d65 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded134 expref: 20 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.756264:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 92 00000100:00100000:3.0:1783349930.756276:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+20:2399:x1869977642689024:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349930.756292:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349930.756300:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2d65 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded134 expref: 20 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.756333:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2d65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded134 expref: 20 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.756357:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:3.0:1783349930.756363:0:7459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.756372:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.756379:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.756400:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349930.756443:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+20:2399:x1869977642689024:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 171us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.756451:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 92 00010000:00010000:3.0:1783349930.756587:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2d65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded134 expref: 19 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.756604:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244659f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659516160:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349930.756629:0:12147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.756638:0:12147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.756644:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783349930.756743:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1783349930.756848:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1783349930.756884:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1783349930.756958:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244659f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12147:1869977659516288:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783349930.757000:0:12147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349930.757025:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3581cf900 going to sleep for 11 seconds 00000100:00100000:3.0:1783349930.757042:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659516288 00000100:00100000:3.0:1783349930.757046:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659516288 00000100:00100000:3.0:1783349930.757077:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783349930.757085:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12147:x1869977659516288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783349930.757184:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12147:x1869977659516288:12345-0@lo:1000:mdt00_004.0 Request processed in 99us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.757191:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783349930.757218:0:12147:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1783349930.757223:0:12147:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea2439b5180, transno 4294967316 00000100:00100000:3.0:1783349930.757234:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244659f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12147:1869977659516288:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1783349930.757853:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1783349930.757907:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244659f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12147:1869977659516416:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783349930.758104:0:12147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349930.758163:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cd3300 going to sleep for 11 seconds 00000100:00100000:3.0:1783349930.759235:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659516416 00000100:00100000:3.0:1783349930.759246:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659516416 00000100:00100000:3.0:1783349930.759300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783349930.759392:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12147:x1869977659516416:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783349930.759633:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12147:x1869977659516416:12345-0@lo:1000:mdt00_004.0 Request processed in 243us (1528us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1783349930.759640:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783349930.759694:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244659f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12147:1869977659516416:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1783349930.759751:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759761:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759769:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759776:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349930.759781:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759789:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759807:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:3.0:1783349930.759810:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349930.759815:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759822:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2da4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759861:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ce0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759868:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ce0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759874:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ce0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759878:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349930.759881:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ce0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759887:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ce0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759895:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349930.759897:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349930.759900:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ce0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.759906:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ce0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.760088:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.760105:0:12147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded118 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.760114:0:12147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.760206:0:12147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded118 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.760222:0:12147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded118 expref: 22 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.760238:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659516544:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349930.760397:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349930.763427:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.763459:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642689152 00000100:00100000:3.0:1783349930.763467:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642689152 00010000:00010000:3.0:1783349930.763504:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded118 expref: 23 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.763538:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 93 00000100:00100000:3.0:1783349930.763561:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+23:2399:x1869977642689152:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349930.763576:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349930.763583:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded118 expref: 23 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763595:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded118 expref: 23 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763616:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349930.763621:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763650:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763657:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763673:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349930.763721:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+23:2399:x1869977642689152:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 174us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349930.763730:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 93 00010000:00010000:3.0:1783349930.763857:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2cfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded118 expref: 22 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.763875:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659516544:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349930.763893:0:12147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763901:0:12147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763907:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763920:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763927:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763933:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763946:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349930.763950:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763958:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763965:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349930.763967:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349930.763970:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763976:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2dab lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763988:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.763995:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.764001:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.764019:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341524200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349930.764023:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.764029:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.764048:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea343b1e100) 00010000:00010000:3.0:1783349930.764051:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783349930.764054:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.764060:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341524200/0xd05e6ae1590e2d9d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349930.764213:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+21:12346:x1869977642688768:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 18149us (18281us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1783349930.764222:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 201 00000020:00080000:3.0:1783349930.764226:0:12147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783349930.764321:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349930.764561:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349930.765188:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1783349930.765198:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349930.768095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349930.768132:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642689408 00000100:00100000:3.0:1783349930.768167:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642689408 00000100:00100000:3.0:1783349930.768218:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:3.0:1783349930.768228:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fc8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+21:12346:x1869977642689408:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783349930.768490:0:6521:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783349930.768528:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1783349930.768575:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.768590:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.768617:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.768627:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.768634:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.768640:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.768657:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783349930.768741:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fc8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+23:12346:x1869977642689408:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 514us (653us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1783349930.768749:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 50 00000020:00080000:3.0:1783349930.768754:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783349930.771240:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349930.771251:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.771261:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349930.771265:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.771273:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.771289:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:3.0:1783349930.771292:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783349930.771320:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.771335:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2db2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349930.771352:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349930.771354:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349930.771355:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349930.804177:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642687360 00000100:00100000:1.0:1783349930.804189:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642687360 00000100:00100000:1.0:1783349930.804251:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 383 00000100:00100000:1.0:1783349930.804260:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3586b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642687360:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349930.804341:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3586b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642687360:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 82us (205494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349930.804349:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 383 00010000:00010000:2.0:1783349930.806867:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783349931.068042:0:14652:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349931.068051:0:14652:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349931.068076:0:14652:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1783349931.068082:0:14652:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349931.473474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349931.473676:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642689664 00000100:00100000:0.0:1783349931.473687:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642689664 00000100:00100000:0.0:1783349931.473768:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 202 00000100:00100000:0.0:1783349931.473777:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+23:12357:x1869977642689664:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783349931.473801:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349931.473819:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2db9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded150 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.473963:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2dc0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.473987:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.474000:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349931.474019:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783349931.474241:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b000/0xd05e6ae1590e2db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded150 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.474301:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded150 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.474334:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:0.0:1783349931.474338:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783349931.474341:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b800, rc 0) 00000100:00100000:0.0:1783349931.474481:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+25:12357:x1869977642689664:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 704us (1016us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1783349931.474519:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 202 00000100:00080000:3.0:1783349931.475618:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349931.478277:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349931.478439:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642689792 00000100:00100000:0.0:1783349931.478448:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642689792 00000100:00100000:0.0:1783349931.478496:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 203 00000100:00100000:0.0:1783349931.478505:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+25:12357:x1869977642689792:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:0.0:1783349931.478582:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2dce lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478598:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2dce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478610:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2dce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478623:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2dd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478629:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478650:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478715:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478723:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478730:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349931.478770:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478781:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2dce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478788:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2dce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478794:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2dce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478799:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364bc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349931.478804:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2dce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478811:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2dce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478821:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:0.0:1783349931.478829:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349931.478834:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2dce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478840:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2dce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478852:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478857:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2dd5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478864:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478869:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349931.478871:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478876:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478882:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea349e98500) 00010000:00010000:0.0:1783349931.478885:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349931.478887:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2dd5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478894:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2dd5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478906:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478916:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478922:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478927:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349931.478930:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478935:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478942:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea349e98300) 00010000:00010000:0.0:1783349931.478944:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349931.478947:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.478953:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b200/0xd05e6ae1590e2ddc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349931.479206:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+25:12357:x1869977642689792:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 699us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349931.479214:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 203 00000100:00100000:2.0:1783349931.506381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349931.506465:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642690048 00000100:00100000:3.0:1783349931.506475:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642690048 00000100:00100000:3.0:1783349931.506533:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 204 00000100:00100000:3.0:1783349931.506550:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+25:12360:x1869977642690048:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349931.506569:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349931.506588:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e2de3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded157 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506653:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2dea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506666:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2dea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506676:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2dea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506692:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2df1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506717:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506724:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506825:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506834:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506841:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349931.506850:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783349931.506917:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2dea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506925:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2dea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506932:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2dea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506937:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cda00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349931.506942:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2dea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506950:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2dea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506971:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:3.0:1783349931.506973:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349931.506978:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2dea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506985:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e2dea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.506998:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.507004:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2df1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.507010:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2df1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.507014:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349931.507017:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2df1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.507023:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2df1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.507029:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea370dce200) 00010000:00010000:3.0:1783349931.507032:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349931.507034:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2df1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.507040:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2df1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.507085:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e2de3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded157 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.507098:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded157 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.507105:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:3.0:1783349931.507107:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349931.507110:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031200, rc 0) 00000100:00100000:3.0:1783349931.507225:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+27:12360:x1869977642690048:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 684us (853us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1783349931.507233:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 204 00000100:00100000:2.0:1783349931.511519:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349931.511675:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642690176 00000100:00100000:1.0:1783349931.511685:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642690176 00000100:00100000:1.0:1783349931.511742:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 205 00000100:00100000:1.0:1783349931.511751:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+27:12360:x1869977642690176:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:1.0:1783349931.511813:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.511843:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.511853:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.511887:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.511894:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.511901:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.511906:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349931.511910:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.511917:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.511927:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:1.0:1783349931.511930:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349931.511934:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.511940:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349931.512104:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+27:12360:x1869977642690176:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 352us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349931.512117:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 205 00000100:00100000:2.0:1783349931.515643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349931.515715:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642690432 00000100:00100000:3.0:1783349931.515724:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642690432 00000100:00100000:3.0:1783349931.515777:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:3.0:1783349931.515786:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+27:12360:x1869977642690432:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1783349931.515980:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+28:12360:x1869977642690432:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 195us (344us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1783349931.515988:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:2.0:1783349931.552106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349931.552274:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642690688 00000100:00100000:0.0:1783349931.552283:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642690688 00000100:00100000:0.0:1783349931.552361:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 206 00000100:00100000:0.0:1783349931.552371:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+28:11891:x1869977642690688:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349931.552394:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349931.552424:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2e0d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded15e expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.552523:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.552538:0:8582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded157 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.552713:0:8582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.552746:0:8582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded157 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.552760:0:8582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded157 expref: 29 pid: 6517 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349931.552774:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659516672:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349931.553233:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2427083c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349931.561357:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349931.561552:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642690816 00000100:00100000:1.0:1783349931.561563:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642690816 00010000:00010000:1.0:1783349931.561609:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded157 expref: 30 pid: 6517 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349931.561656:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 94 00000100:00100000:1.0:1783349931.561666:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+30:2400:x1869977642690816:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349931.561680:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349931.561686:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded157 expref: 30 pid: 6517 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.561699:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded157 expref: 30 pid: 6517 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.561720:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:1.0:1783349931.561726:0:7459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.561736:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.561744:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.561761:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349931.561819:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+30:2400:x1869977642690816:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 153us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349931.561841:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 94 00010000:00010000:3.0:1783349931.561986:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2df8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded157 expref: 29 pid: 6517 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349931.562003:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2439b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659516672:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349931.562035:0:8582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.562054:0:8582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.562059:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349931.562077:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783349931.562241:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a800/0xd05e6ae1590e2e0d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded15e expref: 30 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.562268:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded15e expref: 29 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.562275:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:3.0:1783349931.562278:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783349931.562281:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364bc00, rc 0) 00000100:00100000:3.0:1783349931.562326:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+29:11891:x1869977642690688:12345-192.168.203.50@tcp:101:bash.0 Request processed in 9949us (10221us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1783349931.562333:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 206 00000100:00100000:2.0:1783349931.582329:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349931.582846:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642690944 00000100:00100000:0.0:1783349931.582861:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642690944 00000100:00100000:0.0:1783349931.582938:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 207 00000100:00100000:0.0:1783349931.582951:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+29:11891:x1869977642690944:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349931.583304:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349931.583343:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2e22 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded165 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.583412:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2e29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.583428:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2e29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.583442:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2e29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.583828:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ae00/0xd05e6ae1590e2e22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded165 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.583850:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2e29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded165 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.583860:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:0.0:1783349931.583864:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349931.583868:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a600, rc 0) 00000100:00100000:0.0:1783349931.583956:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+30:11891:x1869977642690944:12345-192.168.203.50@tcp:101:bash.0 Request processed in 1007us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349931.583966:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 207 00000100:00100000:2.0:1783349931.642399:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349931.644347:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642691200 00000100:00100000:1.0:1783349931.644365:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642691200 00000100:00100000:1.0:1783349931.644460:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 208 00000100:00100000:1.0:1783349931.644472:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+30:11891:x1869977642691200:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:1.0:1783349931.646694:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.646728:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.646743:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783349931.646892:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1783349931.646929:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000360e89f reply state 0000000082097c93 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.646944:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349931.646953:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:1.0:1783349931.646957:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349931.646961:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783349931.648527:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1783349931.650955:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+34:11891:x1869977642691200:12345-192.168.203.50@tcp:36:bash.0 Request processed in 6469us (8557us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1783349931.650972:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 208 00000020:00080000:1.0:1783349931.650983:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1783349931.658494:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349931.658723:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642691328 00000100:00100000:3.0:1783349931.658740:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642691328 00000100:00100000:3.0:1783349931.658827:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 209 00000100:00100000:3.0:1783349931.658840:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+34:11891:x1869977642691328:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1783349931.658872:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349931.658902:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2e37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded16c expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.659001:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2e37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded16c expref: 35 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.659017:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2e37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded16c expref: 35 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349931.659455:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:3.0:1783349931.659458:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349931.659463:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031200, rc 0) 00000100:00100000:3.0:1783349931.659721:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+35:11891:x1869977642691328:12345-192.168.203.50@tcp:101:bash.0 Request processed in 701us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349931.659732:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 209 00000100:00100000:2.0:1783349931.718407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349931.718519:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642691456 00000100:00100000:0.0:1783349931.718532:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642691456 00000100:00100000:0.0:1783349931.718603:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:0.0:1783349931.718615:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+7:11891:x1869977642691456:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349931.718638:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349931.718666:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000041a2bfe/0xd05e6ae1590e2e3e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded173 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349931.718715:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a4bc2a7, atime: 0x6a4bc2a6, ctime: 0x6a4bc2a7, blocks: 0x8 00010000:00010000:0.0:1783349931.718753:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1783349931.718759:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349931.718768:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000041a2bfe/0xd05e6ae1590e2e3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded173 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.718797:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000041a2bfe/0xd05e6ae1590e2e3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded173 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349931.718812:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364ae00, rc 0) 00000100:00100000:0.0:1783349931.718883:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+8:11891:x1869977642691456:12345-192.168.203.50@tcp:101:bash.0 Request processed in 270us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349931.718892:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:2.0:1783349931.740824:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349931.741681:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642691584 00000100:00100000:1.0:1783349931.741701:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642691584 00002000:00010000:1.0:1783349931.741791:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1783349931.741798:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea24465ea00 with x1869977642691584 ext(0->18446744073709551615) 00002000:00010000:1.0:1783349931.741816:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea24465ea00. 00000100:00100000:1.0:1783349931.741863:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:1.0:1783349931.741874:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642691584:12345-192.168.203.50@tcp:10:bash.0 00002000:00010000:1.0:1783349931.743938:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1783349931.743946:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1783349927 -> 1783349930 00002000:00010000:1.0:1783349931.743949:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1783349926 -> 1783349926 00002000:00010000:1.0:1783349931.743952:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1783349927 -> 1783349930 00002000:00010000:1.0:1783349931.743954:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1783349931.744032:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642691584:12345-192.168.203.50@tcp:10:bash.0 Request processed in 2154us (3220us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1783349931.744042:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00002000:00010000:1.0:1783349931.744047:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1783349931.744051:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea24465ea00 with x1869977642691584 ext(0->18446744073709551615) 00002000:00010000:1.0:1783349931.744057:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea24465ea00. 00010000:00010000:3.0:1783349931.844644:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349932.125482:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349932.125610:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642691712 00000100:00100000:3.0:1783349932.125625:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642691712 00000100:00100000:3.0:1783349932.126442:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 210 00000100:00100000:3.0:1783349932.126460:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+35:12374:x1869977642691712:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:3.0:1783349932.126552:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e45 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126576:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126589:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126607:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126630:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126638:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126724:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126733:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126740:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349932.126797:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126810:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126818:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e45 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126826:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126832:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349932.126836:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126844:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e45 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126864:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:3.0:1783349932.126867:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349932.126871:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126879:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126895:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126902:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126908:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126913:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349932.126916:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126921:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126928:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea370dce200) 00010000:00010000:3.0:1783349932.126930:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349932.126933:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126938:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126967:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126974:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126980:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126985:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349932.126988:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.126994:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.127000:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:3.0:1783349932.127003:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349932.127006:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.127012:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349932.127114:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+35:12374:x1869977642691712:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 659us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349932.127124:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 210 00000100:00100000:3.0:1783349932.236803:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349932.238451:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642691968 00000100:00100000:1.0:1783349932.238469:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642691968 00000100:00100000:1.0:1783349932.238760:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 211 00000100:00100000:1.0:1783349932.238772:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+35:12377:x1869977642691968:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783349932.238800:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349932.238828:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2e5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded17a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.238920:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2e61 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.238954:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2e61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.238969:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2e61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.238987:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2e68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.238994:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.239001:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.239165:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2e6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.239175:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2e6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.239183:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2e6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349932.239197:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783349932.239292:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2e61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.239301:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2e61 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.239308:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2e61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240393:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ce00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349932.240400:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2e61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240410:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2e61 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240428:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:1.0:1783349932.240431:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349932.240437:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2e61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240444:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ce00/0xd05e6ae1590e2e61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240463:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240470:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2e68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240477:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2e68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240482:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349932.240485:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2e68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240491:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2e68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240509:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea24311d800) 00010000:00010000:1.0:1783349932.240512:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349932.240515:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2e68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240522:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d800/0xd05e6ae1590e2e68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240582:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8de00/0xd05e6ae1590e2e5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded17a expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240596:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2e6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded17a expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.240604:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:1.0:1783349932.240606:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783349932.240609:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8da00, rc 0) 00000100:00100000:1.0:1783349932.240698:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+37:12377:x1869977642691968:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1928us (3907us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1783349932.240708:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 211 00000100:00100000:2.0:1783349932.246700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349932.246808:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642692096 00000100:00100000:3.0:1783349932.246821:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642692096 00000100:00100000:3.0:1783349932.246947:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 212 00000100:00100000:3.0:1783349932.246959:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+37:12377:x1869977642692096:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1783349932.247052:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.247074:0:8582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded15e expref: 37 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.247086:0:8582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.247132:0:8582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded15e expref: 37 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.247240:0:8582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded15e expref: 37 pid: 8582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349932.247258:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659516800:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349932.247583:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1783349932.255085:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349932.255176:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642692352 00000100:00100000:3.0:1783349932.255188:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642692352 00000100:00100000:3.0:1783349932.255264:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:3.0:1783349932.255276:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+38:6631:x1869977642692352:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783349932.255679:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+39:6631:x1869977642692352:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 404us (606us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1783349932.255689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:2.0:1783349932.256417:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659516800:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783349932.256452:0:8582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349932.259995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349932.263705:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642692480 00000100:00100000:0.0:1783349932.263723:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642692480 00010000:00010000:0.0:1783349932.263793:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded15e expref: 39 pid: 8582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349932.263851:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:0.0:1783349932.263862:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea35094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+39:2399:x1869977642692480:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349932.263884:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349932.263892:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded15e expref: 39 pid: 8582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349932.263934:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded15e expref: 39 pid: 8582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349932.263960:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e2e14 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded15e expref: 39 pid: 8582 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349932.263981:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:0.0:1783349932.263987:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349932.263998:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349932.264455:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349932.264820:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349932.268391:0:8582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.268415:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.268473:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.268480:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.268489:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.268495:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349932.268500:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.268517:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.268547:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:2.0:1783349932.268550:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349932.268554:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.268588:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349932.268752:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea35094bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+38:2399:x1869977642692480:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 4884us (8762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349932.268765:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:2.0:1783349932.270875:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+37:12377:x1869977642692096:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 23901us (24171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349932.270892:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 212 00000100:00100000:2.0:1783349932.309983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349932.314249:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642692736 00000100:00100000:3.0:1783349932.314413:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642692736 00000100:00100000:2.0:1783349932.314876:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:2.0:1783349932.314889:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+37:12377:x1869977642692736:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349932.315232:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+38:12377:x1869977642692736:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 345us (5263us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1783349932.315241:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:0.0:1783349932.421872:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349932.421903:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659516928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349932.421994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1783349932.424674:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1783349932.424696:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:2.0:1783349932.439975:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659516928 00000100:00100000:2.0:1783349932.439999:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659516928 00000100:00100000:2.0:1783349932.440093:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783349932.440106:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659516928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783349932.440196:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783349932.440795:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659516928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 685us (18793us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349932.440806:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783349932.440964:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659516928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349932.551649:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349932.552278:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642692992 00000100:00100000:3.0:1783349932.552353:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642692992 00000100:00100000:3.0:1783349932.552435:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 213 00000100:00100000:3.0:1783349932.552447:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+38:12388:x1869977642692992:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:3.0:1783349932.552478:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349932.552503:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded181 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.552724:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.552742:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.552754:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.552769:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2e92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.552775:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.552782:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.552919:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.552929:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.552960:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349932.552971:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1783349932.553064:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553072:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553080:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553087:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349932.553091:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553099:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553113:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:3.0:1783349932.553116:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349932.553122:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553129:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2e8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553609:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553618:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2e92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553633:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553639:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349932.553642:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553648:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2e92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553659:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea370dce200) 00010000:00010000:3.0:1783349932.553661:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349932.553664:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2e92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.553670:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2e92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.555603:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2e84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded181 expref: 41 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.555628:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded181 expref: 40 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.555638:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:3.0:1783349932.555641:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349932.555644:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031c00, rc 0) 00000100:00100000:3.0:1783349932.555752:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+40:12388:x1869977642692992:12345-192.168.203.50@tcp:101:cat.0 Request processed in 3306us (4115us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1783349932.555781:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 213 00000100:00100000:3.0:1783349932.572203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349932.572404:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642693248 00000100:00100000:0.0:1783349932.572417:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642693248 00000100:00100000:0.0:1783349932.572493:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:0.0:1783349932.572522:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+40:12388:x1869977642693248:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:0.0:1783349932.572910:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+41:12388:x1869977642693248:12345-192.168.203.50@tcp:35:cat.0 Request processed in 389us (720us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1783349932.572919:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:2.0:1783349932.641770:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349932.642067:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642693504 00000100:00100000:1.0:1783349932.642080:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642693504 00000100:00100000:1.0:1783349932.642197:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 214 00000100:00100000:1.0:1783349932.642210:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+41:12389:x1869977642693504:12345-192.168.203.50@tcp:36:rm.0 00010000:00010000:1.0:1783349932.642322:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1783349932.642361:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2e37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded16c expref: 41 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642390:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2e99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded181 expref: 40 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642403:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2e6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded17a expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642416:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e2e29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded165 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642427:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:1.0:1783349932.642432:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349932.642460:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2ea7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642476:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2ea7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642487:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2ea7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642504:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642511:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642542:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642646:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2eb5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642655:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2eb5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.642662:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2eb5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349932.642930:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1783349932.642942:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373437805244ns, next at 374437802015ns, rc = 0 00010000:00010000:1.0:1783349932.642998:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643007:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643016:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643023:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643031:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643038:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643075:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349932.643100:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2eb5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643107:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2eb5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643113:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2eb5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643119:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ca00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349932.643124:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2eb5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643132:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2eb5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643204:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:1.0:1783349932.643207:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783349932.643213:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2eb5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643219:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e2eb5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643237:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2ea7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643243:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2ea7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643249:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2ea7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643260:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349932.643263:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2ea7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643269:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2ea7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643277:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:1.0:1783349932.643279:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349932.643282:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2ea7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643288:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d600/0xd05e6ae1590e2ea7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349932.643297:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052ea8044 reply state 0000000093702156 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643318:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.643324:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea24311d800) 00010000:00010000:1.0:1783349932.643327:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783349932.643330:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349932.643418:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+39:12389:x1869977642693504:12345-192.168.203.50@tcp:36:rm.0 Request processed in 1208us (1660us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1783349932.643427:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 214 00010000:00010000:3.0:1783349932.645333:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349932.645349:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.645362:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349932.645366:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.645376:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.645394:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:3.0:1783349932.645398:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783349932.645402:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.645408:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2ebc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349932.645429:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349932.645431:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349932.645433:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349932.745976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349932.746228:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642693760 00000100:00100000:2.0:1783349932.746242:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642693760 00000100:00100000:2.0:1783349932.746556:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 215 00000100:00100000:2.0:1783349932.746569:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+39:12395:x1869977642693760:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783349932.746622:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349932.746650:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2ec3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded188 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.746787:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2eca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.746803:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2eca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.746816:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2eca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.746826:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.746833:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.746839:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349932.747248:0:8582:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1783349932.750835:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.750863:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.750877:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.750952:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2eca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.750959:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2eca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.750966:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2eca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.750971:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349932.750975:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2eca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.750983:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2eca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.750998:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349932.751001:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349932.751006:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2eca lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.751012:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2eca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349932.751028:0:8582:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000185048b8 reply state 000000004cd88c57 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.751042:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.751049:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea24311d800) 00010000:00010000:2.0:1783349932.751057:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783349932.751061:0:8582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783349932.751110:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e2ec3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded188 expref: 42 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.751126:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded188 expref: 41 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.751168:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea2424c5500) 00010000:00010000:2.0:1783349932.751171:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349932.751174:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6a00, rc 0) 00000100:00100000:2.0:1783349932.751619:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+42:12395:x1869977642693760:12345-192.168.203.50@tcp:101:bash.0 Request processed in 5049us (5653us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1783349932.751629:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 215 00000100:00100000:3.0:1783349932.782483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349932.782634:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642693888 00000100:00100000:2.0:1783349932.782650:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642693888 00000100:00100000:2.0:1783349932.782751:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:2.0:1783349932.782764:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2401:x1869977642693888:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783349932.782790:0:9981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349932.782818:0:9981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081734286/0xd05e6ae1590e2ee6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded18f expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349932.782849:0:9981:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783349932.782879:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1783349932.782884:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349932.782895:0:9981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081734286/0xd05e6ae1590e2ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded18f expref: 6 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.782942:0:9981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081734286/0xd05e6ae1590e2ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded18f expref: 6 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.782959:0:9981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7000, rc 0) 00000100:00100000:2.0:1783349932.783037:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+6:2401:x1869977642693888:12345-192.168.203.50@tcp:101:bash.0 Request processed in 276us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349932.783045:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00080000:3.0:1783349932.783720:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349932.797030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349932.797488:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642694016 00000100:00100000:1.0:1783349932.797501:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642694016 00000100:00100000:1.0:1783349932.840599:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:1.0:1783349932.840619:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+6:12395:x1869977642694016:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1783349932.840638:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349932.840655:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded196 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.840685:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081734286/0xd05e6ae1590e2ee6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded18f expref: 7 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.840695:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349932.840699:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349932.840703:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 7 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.840734:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081734286/0xd05e6ae1590e2ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded18f expref: 7 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.840745:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081734286/0xd05e6ae1590e2ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded18f expref: 7 pid: 9981 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349932.840759:0:13811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13811:1869977659517056:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349932.840952:0:13811:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a240 going to sleep for 11 seconds 00010000:00010000:2.0:1783349932.868633:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349932.876259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349932.876692:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642694144 00000100:00100000:2.0:1783349932.876701:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642694144 00010000:00010000:2.0:1783349932.876740:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081734286/0xd05e6ae1590e2ee6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded18f expref: 8 pid: 9981 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349932.876772:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:2.0:1783349932.876782:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2445e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642694144:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349932.876797:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349932.877026:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081734286/0xd05e6ae1590e2ee6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded18f expref: 8 pid: 9981 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.877041:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081734286/0xd05e6ae1590e2ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded18f expref: 8 pid: 9981 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.877063:0:13183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349932.877067:0:13183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349932.877088:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 8 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.877098:0:13183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 8 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349932.877157:0:13183:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 8 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349932.877173:0:13183:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13183:1869977659517184:192.168.203.50@tcp:105: 00010000:00010000:1.0:1783349932.877541:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081734286/0xd05e6ae1590e2ee6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded18f expref: 8 pid: 9981 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349932.877557:0:13811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13811:1869977659517056:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349932.877584:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 7 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349932.877594:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8ca00, rc 0) 00000100:00100000:2.0:1783349932.877652:0:13183:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963600 going to sleep for 11 seconds 00000100:00100000:1.0:1783349932.878127:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+7:12395:x1869977642694016:12345-192.168.203.50@tcp:101:bash.0 Request processed in 37515us (81110us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349932.878167:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:2.0:1783349932.884097:0:13183:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13183:1869977659517184:192.168.203.50@tcp:105: 00010000:00010000:2.0:1783349932.884126:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349932.884207:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2445e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+6:2399:x1869977642694144:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 7425us (7967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349932.884218:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:2.0:1783349932.886977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349932.887381:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642694400 00000100:00100000:0.0:1783349932.887390:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642694400 00000100:00100000:0.0:1783349932.887444:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:0.0:1783349932.887454:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+42:12395:x1869977642694400:12345-192.168.203.50@tcp:35:bash.0 00000001:00080000:0.0:1783349932.888057:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000100:00100000:0.0:1783349932.888430:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+44:12395:x1869977642694400:12345-192.168.203.50@tcp:35:bash.0 Request processed in 974us (1456us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1783349932.888438:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00000020:00080000:0.0:1783349932.888443:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783349933.285821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349933.285965:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642694528 00000100:00100000:3.0:1783349933.285979:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642694528 00000100:00080000:2.0:1783349933.286602:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349933.286719:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 216 00000100:00100000:3.0:1783349933.286753:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+44:12411:x1869977642694528:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349933.286789:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349933.286820:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded19d expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.286908:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2efb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.286924:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.286939:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349933.286996:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783349933.287000:0:12147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349933.287703:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.287741:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded19d expref: 46 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.287768:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded19d expref: 45 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.287778:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:3.0:1783349933.287781:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349933.287785:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030800, rc 0) 00000100:00100000:3.0:1783349933.287875:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+45:12411:x1869977642694528:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1126us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349933.287899:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 216 00000100:00100000:1.0:1783349933.295505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349933.295664:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642694784 00000100:00100000:3.0:1783349933.295688:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642694784 00000100:00100000:3.0:1783349933.295762:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 217 00000100:00100000:3.0:1783349933.295774:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+45:12411:x1869977642694784:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349933.295802:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349933.295829:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.295978:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2f09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.295994:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.296008:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349933.296021:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783349933.296436:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1a4 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.296459:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2f09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1a4 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.296470:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea2424c5500) 00010000:00010000:3.0:1783349933.296473:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349933.296477:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031c00, rc 0) 00000100:00100000:3.0:1783349933.297066:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+47:12411:x1869977642694784:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1292us (1575us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1783349933.297076:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 217 00000100:00100000:2.0:1783349933.301812:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349933.302000:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642694912 00000100:00100000:3.0:1783349933.302013:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642694912 00000100:00100000:3.0:1783349933.302096:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:3.0:1783349933.302107:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+47:2400:x1869977642694912:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349933.302128:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349933.302203:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2f09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1a4 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.302229:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea2424c5500) 00010000:00010000:3.0:1783349933.302235:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349933.302320:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+46:2400:x1869977642694912:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 214us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349933.302329:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:1.0:1783349933.309937:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349933.310063:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642695168 00000100:00100000:2.0:1783349933.310076:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642695168 00000100:00100000:1.0:1783349933.310534:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 218 00000100:00100000:1.0:1783349933.310549:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+46:12411:x1869977642695168:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783349933.310581:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349933.310610:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e2f17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.310758:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.310777:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.310790:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349933.310805:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783349933.310943:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e2f17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ab expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.310989:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ab expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.310999:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea2424c5500) 00010000:00010000:1.0:1783349933.311002:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783349933.311017:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8da00, rc 0) 00000100:00100000:1.0:1783349933.311107:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+48:12411:x1869977642695168:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 562us (1184us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1783349933.311116:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 218 00000100:00100000:1.0:1783349933.326739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349933.326953:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642695296 00000100:00100000:2.0:1783349933.326967:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642695296 00000100:00100000:2.0:1783349933.327046:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:2.0:1783349933.327058:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+6:2402:x1869977642695296:12345-192.168.203.50@tcp:1:lfs.0 00010000:00010000:2.0:1783349933.327127:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.327402:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 6 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.327412:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783349933.327417:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349933.327423:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.327486:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 6 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.327503:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 6 pid: 13811 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349933.327518:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1869977659517312:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349933.327733:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963600 going to sleep for 11 seconds 00000100:00100000:3.0:1783349933.332246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349933.332636:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642695424 00000100:00100000:1.0:1783349933.332649:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642695424 00000100:00100000:2.0:1783349933.333045:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1869977659517312:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783349933.333082:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1783349933.333398:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ea244525c00 x1869977642695424/t0(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:684/0 lens 504/0 e 0 to 0 dl 1783349944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783349933.333410:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea244525c00 with x1869977642695424 ext(0->8) 00010000:00010000:0.0:1783349933.333419:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 7 pid: 13811 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349933.333434:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 7 pid: 13811 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349933.333443:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ea244525c00 00000100:00100000:0.0:1783349933.333532:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1783349933.333560:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642695424:12345-192.168.203.50@tcp:4:lfs.0 00000100:00100000:0.0:1783349933.334810:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689af055-7605-419d-81ba-26cff8cb556b+9:2400:x1869977642695424:12345-192.168.203.50@tcp:4:lfs.0 Request processed in 1242us (2567us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783349933.334823:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00002000:00100000:0.0:1783349933.334834:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ea244525c00 x1869977642695424/t4294967309(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:684/0 lens 504/448 e 0 to 0 dl 1783349944 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783349933.334846:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea244525c00 with x1869977642695424 ext(0->8) 00010000:00010000:0.0:1783349933.334857:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 9 pid: 13811 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349933.334876:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 9 pid: 13811 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349933.334884:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ea244525c00 00000100:00100000:3.0:1783349933.338415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349933.338553:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642695552 00000100:00100000:2.0:1783349933.338567:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642695552 00010000:00010000:2.0:1783349933.338623:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 9 pid: 13811 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349933.338706:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 97 00000100:00100000:2.0:1783349933.338717:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+9:2402:x1869977642695552:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349933.338737:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783349933.338762:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783349933.338765:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783349932 00002000:00010000:2.0:1783349933.338767:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783349932 00002000:00010000:2.0:1783349933.338769:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1783349932 00002000:00010000:2.0:1783349933.338771:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783349933.338777:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 9 pid: 13811 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.338793:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 9 pid: 13811 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.338823:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002581527f/0xd05e6ae1590e2eed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded196 expref: 9 pid: 13811 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.338846:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349933.338851:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349933.338858:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.338869:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.338916:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349933.338980:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689af055-7605-419d-81ba-26cff8cb556b+8:2402:x1869977642695552:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 264us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349933.338988:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 97 00010000:00010000:2.0:1783349933.339019:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.339029:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.339054:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.339063:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.339073:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.339081:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783349933.339086:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.339094:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.339119:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.340959:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653d6f9d/0xd05e6ae1590e2f2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349933.341287:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642695296:12345-192.168.203.50@tcp:1:lfs.0 Request processed in 14221us (14551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349933.341312:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:3.0:1783349933.350747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349933.351550:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642695808 00000100:00100000:2.0:1783349933.351565:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642695808 00000100:00100000:2.0:1783349933.351649:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:2.0:1783349933.351661:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea349fc8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+48:12411:x1869977642695808:12345-192.168.203.50@tcp:35:lfs.0 00000004:00010000:2.0:1783349933.351746:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ab expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349933.351989:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1783349933.352023:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1783349933.352798:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:2.0:1783349933.352849:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.352866:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded188 expref: 52 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.352875:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.352936:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded188 expref: 52 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.352953:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded188 expref: 52 pid: 8582 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349933.352971:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1869977659517440:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349933.353667:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963600 going to sleep for 11 seconds 00000100:00100000:2.0:1783349933.357073:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1869977659517440:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783349933.357113:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349933.360661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349933.362634:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642695936 00000100:00100000:1.0:1783349933.362655:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642695936 00010000:00010000:1.0:1783349933.362725:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded188 expref: 53 pid: 8582 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349933.362837:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 98 00000100:00100000:1.0:1783349933.362847:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+53:2400:x1869977642695936:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349933.362867:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349933.362875:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded188 expref: 53 pid: 8582 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.362891:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded188 expref: 53 pid: 8582 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.362944:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e2ed8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded188 expref: 53 pid: 8582 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.362964:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea2424c5500) 00010000:00010000:1.0:1783349933.362969:0:13183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.362979:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.362988:0:13183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.363336:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349933.363419:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+52:2400:x1869977642695936:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 572us (2772us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349933.363429:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 98 00010000:00010000:0.0:1783349933.369353:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349933.369377:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349933.369618:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:0.0:1783349933.369917:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1783349933.370053:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659517568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783349933.371021:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349933.371069:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dc20300 going to sleep for 11 seconds 00000100:00100000:3.0:1783349933.371265:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659517568 00000100:00100000:3.0:1783349933.371276:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659517568 00000100:00100000:3.0:1783349933.371448:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783349933.371459:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1869977659517568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783349933.371591:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1869977659517568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 134us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349933.371599:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783349933.371748:0:6521:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1783349933.371755:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1783349933.371778:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea243144000, transno 4294967308 00000100:00100000:1.0:1783349933.371801:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659517568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783349933.371956:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1783349933.372029:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659517696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783349933.372067:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349933.372085:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5a900 going to sleep for 11 seconds 00000100:00100000:1.0:1783349933.372099:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659517696 00000100:00100000:1.0:1783349933.372102:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659517696 00000100:00100000:1.0:1783349933.372173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783349933.372180:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1869977659517696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783349933.372280:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1869977659517696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 101us (212us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783349933.372299:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783349933.372338:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1869977659517696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783349933.372373:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1783349933.372406:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.372417:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.372425:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.372432:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349933.372437:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.372446:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.372464:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea2424c5500) 00010000:00010000:1.0:1783349933.372467:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783349933.372471:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.372477:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e2f33 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783349933.372696:0:6521:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783349933.372760:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1783349933.372771:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374167634322ns, next at 375167632380ns, rc = 0 00000001:00080000:1.0:1783349933.372777:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1783349933.372797:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea2424c5500) 00010000:00010000:1.0:1783349933.372800:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783349933.372808:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f1e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ab expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349933.372909:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea349fc8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+55:12411:x1869977642695808:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 21251us (22177us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1783349933.372917:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000020:00080000:1.0:1783349933.372920:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1783349933.376335:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349933.379603:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349933.379731:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642696064 00000100:00100000:3.0:1783349933.379749:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642696064 00000100:00100000:3.0:1783349933.379847:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 219 00000100:00100000:3.0:1783349933.379859:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+55:12411:x1869977642696064:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349933.379887:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349933.379917:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2f3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1b2 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.379985:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2f3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1b2 expref: 56 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.380001:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2f3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1b2 expref: 56 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.380021:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349933.380025:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349933.380029:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031c00, rc 0) 00000100:00100000:3.0:1783349933.380161:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+56:12411:x1869977642696064:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 304us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349933.380170:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 219 00000100:00100000:0.0:1783349933.384673:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349933.384809:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642696320 00000100:00100000:2.0:1783349933.384821:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642696320 00000100:00100000:2.0:1783349933.384929:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:2.0:1783349933.384940:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+56:12411:x1869977642696320:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783349933.385469:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+57:12411:x1869977642696320:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 528us (809us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1783349933.385479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:2.0:1783349933.496503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349933.496873:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642696448 00000100:00100000:3.0:1783349933.496887:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642696448 00000100:00100000:3.0:1783349933.497022:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 220 00000100:00100000:3.0:1783349933.497035:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+57:12421:x1869977642696448:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:3.0:1783349933.497617:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.497643:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349933.497676:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498163:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498177:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498249:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498425:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498434:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498442:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349933.498514:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498605:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498614:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f41 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498621:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498628:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349933.498633:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498641:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f41 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498656:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349933.498666:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349933.498672:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498679:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2f41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498698:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498704:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498711:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498716:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349933.498720:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498726:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498734:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea24311d800) 00010000:00010000:2.0:1783349933.498737:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349933.498740:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498745:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498755:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498768:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498774:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498779:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349933.498782:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498788:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498796:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:2.0:1783349933.498798:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349933.498801:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.498807:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349933.498985:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+57:12421:x1869977642696448:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 1947us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349933.498997:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 220 00000100:00100000:0.0:1783349933.577441:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349933.583771:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642696704 00000100:00100000:2.0:1783349933.583787:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642696704 00000100:00100000:2.0:1783349933.583889:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 221 00000100:00100000:2.0:1783349933.583900:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+57:12424:x1869977642696704:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349933.583921:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349933.583954:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1b9 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.584027:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f5d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.584042:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.584053:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.584063:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2f64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.584071:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2f64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.584077:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2f64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.584197:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2f6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.584206:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2f6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.584213:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2f6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349933.584222:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783349933.584296:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677488:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f5d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677498:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677506:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349933.677511:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677521:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f5d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677538:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349933.677542:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349933.677546:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677553:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2f5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677575:0:8582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2f64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677592:0:8582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2f64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677598:0:8582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2f64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677603:0:8582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349933.677623:0:8582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2f64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677630:0:8582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2f64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677638:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea24311d800) 00010000:00010000:2.0:1783349933.677641:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349933.677644:0:8582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2f64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677650:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6200/0xd05e6ae1590e2f64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677725:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e2f56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1b9 expref: 60 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677742:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2f6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1b9 expref: 59 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349933.677769:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:2.0:1783349933.677772:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349933.677775:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6e00, rc 0) 00000100:00100000:2.0:1783349933.678060:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+59:12424:x1869977642696704:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 94161us (100627us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1783349933.678116:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 221 00000100:00100000:0.0:1783349933.721878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349933.724945:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642696832 00000100:00100000:3.0:1783349933.724964:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642696832 00000100:00100000:1.0:1783349933.726973:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 222 00000100:00100000:1.0:1783349933.731006:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+59:12424:x1869977642696832:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:1.0:1783349933.732989:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.733024:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.733040:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.735257:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.735517:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.736001:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.736008:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8da00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349933.736013:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.736024:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.736102:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:1.0:1783349933.736106:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349933.736114:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f79 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349933.736122:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2f79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349933.741250:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+59:12424:x1869977642696832:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 14237us (19358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349933.741401:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 222 00000100:00100000:3.0:1783349933.802746:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349933.803500:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642697088 00000100:00100000:1.0:1783349933.803516:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642697088 00000100:00100000:1.0:1783349933.803608:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:1.0:1783349933.803621:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+59:12424:x1869977642697088:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1783349933.803943:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+60:12424:x1869977642697088:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 324us (1210us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1783349933.803952:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00010000:00010000:1.0:1783349933.951237:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783349933.951625:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349933.951633:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783349933.951687:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1783349933.951699:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1783349933.952827:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00080000:1.0:1783349934.043295:0:9985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374838155402ns, next at 375838151895ns, rc = 0 00000100:00100000:3.0:1783349934.043688:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349934.043731:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642697344 00000100:00100000:3.0:1783349934.043742:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642697344 00000100:00100000:3.0:1783349934.043807:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 223 00000100:00100000:3.0:1783349934.043816:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+60:12434:x1869977642697344:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1783349934.043850:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349934.043853:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783349934.043886:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2efb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded19d expref: 60 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.043910:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:3.0:1783349934.043916:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349934.043930:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2f80 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.044056:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2f87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.044071:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2f87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.044083:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2f87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349934.044112:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783349934.044259:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2f80 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c0 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.044274:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2f87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c0 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.044281:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349934.044284:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349934.044287:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031200, rc 0) 00000100:00100000:2.0:1783349934.044498:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659517824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349934.044576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349934.044657:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659517824 00000100:00100000:2.0:1783349934.044670:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659517824 00000100:00100000:2.0:1783349934.044712:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783349934.044719:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659517824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349934.044744:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783349934.044785:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659517824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349934.044792:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783349934.044843:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659517824:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783349934.046486:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349934.046519:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659518080:0@lo:400:kworker.0 00000100:00100000:0.0:1783349934.048507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349934.048585:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659518592:0@lo:400:kworker.0 00000100:00100000:0.0:1783349934.048612:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349934.048634:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659519104:0@lo:400:kworker.0 00000100:00100000:0.0:1783349934.048657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349934.048815:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659518080 00000100:00100000:0.0:1783349934.048825:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659518080 00000100:00100000:0.0:1783349934.048878:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659518592 00000100:00100000:0.0:1783349934.048882:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659518592 00000100:00100000:0.0:1783349934.048903:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659519104 00000100:00100000:0.0:1783349934.048906:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659519104 00000100:00100000:0.0:1783349934.048923:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1783349934.048932:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659518080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349934.048996:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659518080:12345-0@lo:400:kworker.0 Request processed in 65us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349934.049005:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1783349934.049025:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1783349934.049031:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659518592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349934.049080:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659518592:12345-0@lo:400:kworker.0 Request processed in 49us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349934.049087:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1783349934.049099:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1783349934.049105:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659519104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349934.049131:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659519104:12345-0@lo:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349934.049163:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:0.0:1783349934.049181:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349934.049185:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349934.049217:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659518080:0@lo:400:kworker.0 00000100:00100000:0.0:1783349934.049229:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659518592:0@lo:400:kworker.0 00010000:00080000:0.0:1783349934.049241:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24465ed80 x1869977659519104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349934.049251:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659519104:0@lo:400:kworker.0 00000100:00100000:3.0:1783349934.049479:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+61:12434:x1869977642697344:12345-192.168.203.50@tcp:101:bash.0 Request processed in 5659us (5795us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1783349934.049488:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 223 00000100:00100000:1.0:1783349934.049752:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659518208:0@lo:400:kworker.0 00000100:00100000:1.0:1783349934.049804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349934.049848:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659518720:0@lo:400:kworker.0 00000100:00100000:1.0:1783349934.049895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349934.049925:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659519232:0@lo:400:kworker.0 00000100:00100000:1.0:1783349934.049953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349934.050010:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659518720 00000100:00100000:1.0:1783349934.050016:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659518720 00000100:00100000:1.0:1783349934.050055:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1783349934.050061:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659518720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349934.050100:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659518720:12345-0@lo:400:kworker.0 Request processed in 39us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349934.050106:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00080000:1.0:1783349934.050159:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243bac700 x1869977659518720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349934.050172:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659518720:0@lo:400:kworker.0 00000100:00080000:1.0:1783349934.050200:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783349934.050211:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659519232 00000100:00100000:1.0:1783349934.050214:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659519232 00000100:00100000:1.0:1783349934.050247:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783349934.050254:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659519232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349934.050289:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659519232:12345-0@lo:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349934.051509:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659517952:0@lo:400:kworker.0 00000100:00100000:2.0:1783349934.051593:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349934.051633:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659518464:0@lo:400:kworker.0 00000100:00100000:2.0:1783349934.051661:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349934.051683:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659518976:0@lo:400:kworker.0 00000100:00100000:2.0:1783349934.051705:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349934.051723:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659519488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349934.051742:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349934.051767:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783349934.051774:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659518336:0@lo:400:kworker.0 00000100:00100000:2.0:1783349934.051795:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349934.051809:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2445e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659518848:0@lo:400:kworker.0 00000100:00100000:2.0:1783349934.051833:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349934.051849:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659519360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349934.051871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349934.051925:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659518208 00000100:00100000:2.0:1783349934.051932:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659518208 00000100:00100000:2.0:1783349934.051986:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659518464 00000100:00100000:2.0:1783349934.051989:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659518464 00000100:00100000:2.0:1783349934.052001:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659519488 00000100:00100000:2.0:1783349934.052003:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659519488 00000100:00100000:2.0:1783349934.052016:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783349934.052024:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659518208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349934.052079:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659518208:12345-0@lo:400:kworker.0 Request processed in 55us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349934.052086:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783349934.052101:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783349934.052106:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659518464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349934.052179:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659518464:12345-0@lo:400:kworker.0 Request processed in 30us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349934.052185:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783349934.052197:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783349934.052203:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659519488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783349934.052232:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349934.052266:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659519488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349934.052272:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783349934.053461:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659518848 00000100:00100000:3.0:1783349934.053477:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659518848 00000100:00100000:0.0:1783349934.053796:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659518976 00000100:00100000:0.0:1783349934.053802:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659518976 00000100:00100000:0.0:1783349934.053848:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659518336 00000100:00100000:0.0:1783349934.053852:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659518336 00000100:00100000:0.0:1783349934.053881:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1783349934.053891:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659518976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349934.054531:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1783349934.054582:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349934.054589:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783349934.054592:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349934.054657:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659518208:0@lo:400:kworker.0 00000100:00100000:1.0:1783349934.054676:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659519232:0@lo:400:kworker.0 00000100:00100000:1.0:1783349934.054743:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1783349934.054753:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659518336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349934.054804:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659518336:12345-0@lo:400:kworker.0 Request processed in 53us (3007us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349934.054811:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1783349934.054999:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659519360 00000100:00100000:2.0:1783349934.055015:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659519360 00000100:00100000:2.0:1783349934.055052:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783349934.055059:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659519360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783349934.055079:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783349934.055119:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659519360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (3246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349934.055153:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783349934.055187:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659518336:0@lo:400:kworker.0 00000100:00100000:2.0:1783349934.055207:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659519360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349934.055220:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659518464:0@lo:400:kworker.0 00000100:00100000:2.0:1783349934.055233:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869977659518976:0@lo:400:kworker.0 00000100:00100000:2.0:1783349934.055248:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659519488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783349934.055690:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783349934.055702:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659518848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349934.055754:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659518848:12345-0@lo:400:kworker.0 Request processed in 55us (3919us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349934.055761:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783349934.055788:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659517952 00000100:00100000:3.0:1783349934.055794:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659517952 00000100:00100000:3.0:1783349934.055824:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1783349934.055830:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659517952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349934.055863:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659517952:12345-0@lo:400:kworker.0 Request processed in 33us (4270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349934.055882:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1783349934.055931:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2445e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659518848:0@lo:400:kworker.0 00000100:00100000:3.0:1783349934.055942:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659517952:0@lo:400:kworker.0 00000100:00100000:0.0:1783349934.056054:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869977659518976:12345-0@lo:400:kworker.0 Request processed in 116us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349934.056065:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1783349934.056739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349934.056781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349934.056901:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642697472 00000100:00100000:0.0:1783349934.056916:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642697472 00000100:00100000:0.0:1783349934.056962:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 224 00000100:00100000:0.0:1783349934.056971:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+61:12434:x1869977642697472:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1783349934.056994:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1783349934.057273:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642697600 00000100:00100000:2.0:1783349934.057385:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642697600 00000100:00100000:2.0:1783349934.057432:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:2.0:1783349934.057440:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+62:2402:x1869977642697600:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349934.057452:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349934.057480:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2f87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c0 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.057502:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:2.0:1783349934.057507:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349934.057687:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2f95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1c7 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.057725:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.057739:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.057750:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.057873:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a400/0xd05e6ae1590e2f95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c7 expref: 63 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.057888:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c7 expref: 62 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.057896:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:0.0:1783349934.057898:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349934.057901:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a200, rc 0) 00000100:00100000:0.0:1783349934.058009:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+62:12434:x1869977642697472:12345-192.168.203.50@tcp:101:bash.0 Request processed in 1038us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349934.058016:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 224 00000100:00100000:2.0:1783349934.058170:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+61:2402:x1869977642697600:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 731us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349934.058178:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:3.0:1783349934.062618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349934.062718:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642697856 00000100:00100000:0.0:1783349934.062754:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642697856 00000100:00100000:0.0:1783349934.062834:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 225 00000100:00100000:0.0:1783349934.062845:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+61:12434:x1869977642697856:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:0.0:1783349934.062920:0:12147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349934.062954:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e2f6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1b9 expref: 61 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.062977:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:0.0:1783349934.062983:0:12147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349934.063269:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.063287:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.063309:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349934.063362:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1783349934.063386:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a16a0cd2 reply state 0000000042822fd4 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.063401:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.063408:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:0.0:1783349934.063411:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783349934.063414:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349934.063527:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+63:12434:x1869977642697856:12345-192.168.203.50@tcp:36:bash.0 Request processed in 682us (922us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1783349934.063536:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 225 00000020:00080000:0.0:1783349934.063551:0:12147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783349934.067071:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349934.067263:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642697984 00000100:00100000:2.0:1783349934.067275:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642697984 00000100:00100000:2.0:1783349934.067365:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 226 00000100:00100000:2.0:1783349934.067376:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+63:12434:x1869977642697984:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783349934.067426:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349934.067453:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2faa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.067582:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.067600:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.067615:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349934.067654:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783349934.067659:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349934.067684:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.067713:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6400/0xd05e6ae1590e2faa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ce expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.067734:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ce expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.067743:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:2.0:1783349934.067746:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349934.067750:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6800, rc 0) 00000100:00100000:2.0:1783349934.067826:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+64:12434:x1869977642697984:12345-192.168.203.50@tcp:101:bash.0 Request processed in 451us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349934.067834:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 226 00000100:00100000:2.0:1783349934.071854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349934.071966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642698240 00000100:00100000:1.0:1783349934.071979:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642698240 00000100:00100000:1.0:1783349934.072064:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:1.0:1783349934.072076:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+64:12434:x1869977642698240:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:1.0:1783349934.072418:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+65:12434:x1869977642698240:12345-192.168.203.50@tcp:35:bash.0 Request processed in 343us (577us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1783349934.072426:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:3.0:1783349934.240635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349934.240791:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642698368 00000100:00100000:1.0:1783349934.240805:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642698368 00000100:00100000:1.0:1783349934.240888:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 227 00000100:00100000:1.0:1783349934.240900:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+65:12440:x1869977642698368:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783349934.240931:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349934.240959:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2fb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1d5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.241040:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2fbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.241073:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.241088:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349934.241171:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783349934.241175:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783349934.241202:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.241233:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2fb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1d5 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.241254:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2fbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1d5 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.241262:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:1.0:1783349934.241265:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349934.241268:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d400, rc 0) 00000100:00100000:1.0:1783349934.241362:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+66:12440:x1869977642698368:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 463us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349934.241371:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 227 00000100:00100000:0.0:1783349934.254959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349934.255670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642698496 00000100:00100000:3.0:1783349934.255688:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642698496 00000100:00100000:3.0:1783349934.255777:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 228 00000100:00100000:3.0:1783349934.255788:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+66:12440:x1869977642698496:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349934.255816:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349934.255844:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2fc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1dc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.255929:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2fcd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.255946:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2fcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.255960:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2fcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.255973:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2fd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.255981:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.256019:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.256129:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2fdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.256416:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2fdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.256424:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2fdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349934.256483:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783349934.256488:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349934.256513:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2fdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257361:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2fdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257374:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2fcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257381:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2fcd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257390:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2fcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257397:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349934.257402:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2fcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257429:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2fcd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257445:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:3.0:1783349934.257448:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349934.257453:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2fcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257459:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e2fcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257480:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257486:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257493:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257498:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349934.257501:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257508:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257515:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea24311d800) 00010000:00010000:3.0:1783349934.257528:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349934.257532:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2fd4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257548:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e2fd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257594:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2fc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1dc expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257610:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2fdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1dc expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.257617:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349934.257619:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349934.257622:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031200, rc 0) 00000100:00100000:3.0:1783349934.257905:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+67:12440:x1869977642698496:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 2116us (2958us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349934.257917:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 228 00000100:00100000:2.0:1783349934.263579:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349934.264104:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642698624 00000100:00100000:3.0:1783349934.264118:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642698624 00000100:00100000:3.0:1783349934.264255:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1783349934.264266:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+67:2400:x1869977642698624:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349934.264306:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349934.264338:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2fdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1dc expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.264359:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349934.264365:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349934.264431:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+66:2400:x1869977642698624:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 167us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349934.264458:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:0.0:1783349934.274531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349934.274652:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642698880 00000100:00100000:1.0:1783349934.274665:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642698880 00000100:00100000:1.0:1783349934.274748:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 229 00000100:00100000:1.0:1783349934.274759:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+66:12440:x1869977642698880:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783349934.274787:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349934.274834:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2fe2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1e3 expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.274982:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.275000:0:8582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ce expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.275269:0:8582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.275438:0:8582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ce expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.275455:0:8582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ce expref: 67 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349934.275474:0:8582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659519616:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783349934.276512:0:8582:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349934.288053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349934.288242:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642699008 00000100:00100000:2.0:1783349934.288254:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642699008 00010000:00010000:2.0:1783349934.288326:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ce expref: 68 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349934.288375:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:2.0:1783349934.288387:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350948050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+68:2399:x1869977642699008:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349934.288407:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349934.288414:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ce expref: 68 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.288429:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ce expref: 68 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.288460:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:2.0:1783349934.288466:0:13183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.288479:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.288487:0:13183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349934.288512:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349934.289312:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350948050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+68:2399:x1869977642699008:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 912us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349934.289349:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 99 00010000:00010000:1.0:1783349934.289598:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e2fb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ce expref: 67 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349934.289622:0:8582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8582:1869977659519616:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783349934.289650:0:8582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.289660:0:8582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.289678:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349934.289707:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783349934.289887:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8da00/0xd05e6ae1590e2fe2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1e3 expref: 68 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.289906:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1e3 expref: 67 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349934.289916:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:1.0:1783349934.289919:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783349934.289923:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c600, rc 0) 00000100:00100000:1.0:1783349934.289967:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+67:12440:x1869977642698880:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 15209us (15462us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1783349934.289975:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 229 00000100:00100000:2.0:1783349934.306940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349934.308608:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642699264 00000100:00100000:0.0:1783349934.308629:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642699264 00000100:00100000:0.0:1783349934.308741:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1783349934.308753:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+67:12440:x1869977642699264:12345-192.168.203.50@tcp:103:lfs.0 00010000:00010000:0.0:1783349934.308776:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349934.308810:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e2f3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1b2 expref: 67 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349934.308837:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:0.0:1783349934.308843:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349934.308936:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+66:12440:x1869977642699264:12345-192.168.203.50@tcp:103:lfs.0 Request processed in 186us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349934.308945:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1783349934.316385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349934.316549:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642699392 00000100:00100000:3.0:1783349934.316564:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642699392 00000100:00100000:3.0:1783349934.316646:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 230 00000100:00100000:3.0:1783349934.316658:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+66:12440:x1869977642699392:12345-192.168.203.50@tcp:58:lfs.0 00010000:00010000:3.0:1783349934.316805:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.316827:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.316840:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783349934.316970:0:12147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1783349934.317481:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+66:12440:x1869977642699392:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 821us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349934.317492:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 230 00000100:00100000:1.0:1783349934.331061:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349934.331271:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642699520 00000100:00100000:3.0:1783349934.331281:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642699520 00000100:00100000:3.0:1783349934.331354:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 231 00000100:00100000:3.0:1783349934.331363:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+66:12440:x1869977642699520:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783349934.331383:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349934.331404:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ffe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.331456:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.331484:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ffe lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ea expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.331503:0:6517:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.331527:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ffe lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ea expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.331541:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349934.331545:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349934.331548:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ffe lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ea expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349934.331556:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030a00, rc 0) 00000100:00100000:3.0:1783349934.331619:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+67:12440:x1869977642699520:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 256us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349934.331627:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 231 00010000:00010000:0.0:1783349934.980587:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783349934.980756:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349934.980767:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349934.980798:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1783349934.980821:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349934.980990:0:13790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659519744:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783349934.981132:0:13790:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349934.987784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349934.994700:0:13790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659519744:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783349934.996334:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642699648 00000100:00100000:0.0:1783349934.996357:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642699648 00000100:00100000:0.0:1783349934.996548:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 232 00000100:00100000:0.0:1783349934.996563:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+67:12441:x1869977642699648:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783349934.996612:0:8582:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783349934.996815:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+67:12441:x1869977642699648:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 255us (9045us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349934.996835:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 232 00000100:00100000:2.0:1783349935.013428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.013558:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642699776 00000100:00100000:3.0:1783349935.013594:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642699776 00000100:00100000:3.0:1783349935.013699:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 233 00000100:00100000:3.0:1783349935.013713:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+67:12441:x1869977642699776:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783349935.013831:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e3005 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.013860:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e3005 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.013876:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e3005 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.013896:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e300c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.013903:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e300c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.013910:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e300c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.013942:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.013952:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.013959:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349935.014022:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783349935.014028:0:12147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783349935.014053:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014068:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e3005 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014075:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e3005 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014082:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e3005 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014089:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.014094:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e3005 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014102:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e3005 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014117:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:3.0:1783349935.014120:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349935.014127:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e3005 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014182:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031800/0xd05e6ae1590e3005 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014201:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e300c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014208:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e300c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014214:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e300c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014226:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.014230:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e300c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014236:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e300c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014245:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8ea370dce600) 00010000:00010000:3.0:1783349935.014248:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349935.014251:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e300c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014258:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e300c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014280:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014286:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014301:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014307:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.014310:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014316:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014338:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349935.014340:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349935.014346:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.014352:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3013 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783349935.014551:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349935.014750:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+67:12441:x1869977642699776:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 1036us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.014763:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 233 00000100:00100000:3.0:1783349935.021021:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.021363:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642700032 00000100:00100000:2.0:1783349935.021377:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642700032 00000100:00100000:2.0:1783349935.021460:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 234 00000100:00100000:2.0:1783349935.021472:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+67:12441:x1869977642700032:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349935.021499:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349935.021534:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e301a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1f1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021676:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3021 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021695:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021709:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349935.021723:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783349935.021840:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021848:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3021 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021874:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3021 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021881:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349935.021886:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3021 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021895:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3021 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021911:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:2.0:1783349935.021914:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783349935.021919:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3021 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021926:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3021 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021977:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e301a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1f1 expref: 69 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.021988:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:2.0:1783349935.021990:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349935.021995:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e301a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1f1 expref: 69 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.022004:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7400, rc 0) 00000100:00100000:2.0:1783349935.022081:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+68:12441:x1869977642700032:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 611us (1077us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1783349935.022099:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 234 00000100:00100000:0.0:1783349935.026853:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.027477:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642700160 00000100:00100000:2.0:1783349935.027491:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642700160 00000100:00100000:2.0:1783349935.027579:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 235 00000100:00100000:2.0:1783349935.027592:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+68:12441:x1869977642700160:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783349935.027652:0:8582:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783349935.027954:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+68:12441:x1869977642700160:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 363us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.027963:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 235 00000100:00100000:3.0:1783349935.032985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.037639:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642700416 00000100:00100000:2.0:1783349935.037673:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642700416 00000100:00100000:2.0:1783349935.037785:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 236 00000100:00100000:2.0:1783349935.037797:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+68:12441:x1869977642700416:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349935.037841:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349935.037846:0:12147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783349935.037887:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d400/0xd05e6ae1590e2fbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1d5 expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.037912:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349935.037919:0:12147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349935.037936:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e302f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1f8 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349935.038984:0:12147:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1783349935.039538:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.039587:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.039602:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.039685:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e302f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1f8 expref: 70 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.039707:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1f8 expref: 69 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.039716:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:2.0:1783349935.039719:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349935.039722:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6800, rc 0) 00000100:00100000:2.0:1783349935.041373:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+69:12441:x1869977642700416:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 3561us (8387us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1783349935.041392:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 236 00000100:00100000:0.0:1783349935.051901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.059094:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642700672 00000100:00100000:2.0:1783349935.059119:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642700672 00000100:00100000:2.0:1783349935.059235:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 237 00000100:00100000:2.0:1783349935.059250:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+69:12441:x1869977642700672:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783349935.059367:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349935.059408:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3036 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1f8 expref: 69 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.059435:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:2.0:1783349935.059478:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349935.061400:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e3044 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061433:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e3044 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061451:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e3044 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061488:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e304b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd5d29f43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061497:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e304b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5d29f43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061503:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e304b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5d29f43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061574:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e3044 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061582:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e3044 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061589:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e3044 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061596:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349935.061601:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e3044 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061610:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e3044 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061642:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:2.0:1783349935.061645:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349935.061651:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e3044 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061658:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e3044 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061677:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e304b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5d29f43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061683:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e304b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5d29f43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061689:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e304b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5d29f43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061694:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349935.061697:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e304b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5d29f43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061703:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e304b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5d29f43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061710:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd5d29f43 (ffff8ea2424c5600) 00010000:00010000:2.0:1783349935.061712:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349935.061715:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e304b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd5d29f43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.061721:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e304b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd5d29f43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.062302:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+68:12441:x1869977642700672:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 3038us (10400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783349935.062314:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 237 00000100:00100000:0.0:1783349935.071169:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.072505:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642700800 00000100:00100000:3.0:1783349935.072532:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642700800 00000100:00100000:3.0:1783349935.072615:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 238 00000100:00100000:3.0:1783349935.072625:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348c37050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+68:12441:x1869977642700800:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349935.072654:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349935.072688:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3052 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded1ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.072733:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.072749:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.072761:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.073099:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031c00/0xd05e6ae1590e3052 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ff expref: 70 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.073168:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ff expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.073179:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:3.0:1783349935.073182:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783349935.073185:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030800, rc 0) 00000100:00100000:3.0:1783349935.073341:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348c37050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+69:12441:x1869977642700800:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 716us (2215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.073350:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 238 00000100:00100000:3.0:1783349935.087805:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.087904:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642701056 00000100:00100000:2.0:1783349935.087920:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642701056 00000100:00100000:2.0:1783349935.088005:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 239 00000100:00100000:2.0:1783349935.088016:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+69:12441:x1869977642701056:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783349935.088175:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.088197:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.088212:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783349935.088455:0:12147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1783349935.088466:0:12147:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375883329304ns, next at 376883326034ns, rc = 0 00000004:00010000:2.0:1783349935.088530:0:12147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5aa8a86 reply state 000000003f257d5d transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.088546:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.088554:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:2.0:1783349935.088557:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783349935.088561:0:12147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349935.088689:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+71:12441:x1869977642701056:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 674us (898us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1783349935.088716:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 239 00000100:00100000:0.0:1783349935.093613:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.094085:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642701184 00000100:00100000:2.0:1783349935.094100:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642701184 00000100:00100000:2.0:1783349935.094192:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 240 00000100:00100000:2.0:1783349935.094206:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+71:12441:x1869977642701184:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349935.094240:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349935.094278:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e3067 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded206 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.094369:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e3067 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded206 expref: 72 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.094389:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e3067 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded206 expref: 72 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.094415:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:2.0:1783349935.094419:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349935.094423:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7400, rc 0) 00000100:00100000:2.0:1783349935.094502:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+72:12441:x1869977642701184:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 299us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.095653:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 240 00000100:00100000:1.0:1783349935.100922:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.104613:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642701312 00000100:00100000:2.0:1783349935.104637:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642701312 00000100:00100000:2.0:1783349935.104769:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:2.0:1783349935.104782:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642701312:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783349935.105100:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689af055-7605-419d-81ba-26cff8cb556b+10:2399:x1869977642701312:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 319us (4191us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783349935.105128:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00080000:1.0:1783349935.105400:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349935.110885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349935.111019:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642701568 00000100:00100000:1.0:1783349935.111034:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642701568 00000100:00100000:1.0:1783349935.111111:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:1.0:1783349935.111123:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+72:12441:x1869977642701568:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783349935.111487:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+73:12441:x1869977642701568:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 364us (614us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1783349935.111530:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:3.0:1783349935.120602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349935.120765:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642701824 00000100:00100000:0.0:1783349935.120777:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642701824 00000100:00100000:0.0:1783349935.120854:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 241 00000100:00100000:0.0:1783349935.120864:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+73:12441:x1869977642701824:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783349935.121005:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+73:12441:x1869977642701824:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 142us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349935.121013:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 241 00000100:00100000:0.0:1783349935.130205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.130335:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642701952 00000100:00100000:2.0:1783349935.130349:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642701952 00000100:00100000:2.0:1783349935.130424:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 242 00000100:00100000:2.0:1783349935.130435:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+73:12441:x1869977642701952:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349935.130463:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349935.130491:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e306e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded20d expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.130591:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3075 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.130609:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.130623:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349935.130679:0:8582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783349935.130704:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.130735:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7a00/0xd05e6ae1590e306e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded20d expref: 75 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.130756:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3075 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded20d expref: 74 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.130766:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:2.0:1783349935.130789:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783349935.130795:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7e00, rc 0) 00000100:00100000:2.0:1783349935.130877:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689af055-7605-419d-81ba-26cff8cb556b+74:12441:x1869977642701952:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 443us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.130885:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 242 00000100:00100000:3.0:1783349935.140926:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.141036:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642702080 00000100:00100000:2.0:1783349935.141049:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642702080 00000100:00100000:2.0:1783349935.141121:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:2.0:1783349935.141176:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+10:2400:x1869977642702080:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349935.141205:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349935.141234:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e307c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded214 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349935.141265:0:13811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc2ae, blocks: 0x0 00010000:00010000:2.0:1783349935.141314:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1783349935.141320:0:13811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349935.141332:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e307c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded214 expref: 11 pid: 13811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.141352:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e307c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded214 expref: 11 pid: 13811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.141370:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7a00, rc 0) 00000100:00100000:2.0:1783349935.141437:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+11:2400:x1869977642702080:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 306us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.141446:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:3.0:1783349935.144461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349935.144626:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642702336 00000100:00100000:0.0:1783349935.144640:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642702336 00000100:00100000:0.0:1783349935.144719:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 243 00000100:00100000:0.0:1783349935.144731:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+74:12441:x1869977642702336:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783349935.144889:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+74:12441:x1869977642702336:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 160us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349935.144899:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 243 00000100:00100000:0.0:1783349935.148438:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.148543:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642702464 00000100:00100000:3.0:1783349935.148556:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642702464 00000100:00100000:3.0:1783349935.148621:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 74 00000100:00100000:3.0:1783349935.148632:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+11:12441:x1869977642702464:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349935.148654:0:9981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349935.148676:0:9981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded21b expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.148713:0:9981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e307c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded214 expref: 12 pid: 13811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.148745:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349935.148750:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349935.148755:0:9981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 12 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.148801:0:9981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e307c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded214 expref: 12 pid: 13811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.148816:0:9981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e307c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded214 expref: 12 pid: 13811 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349935.148834:0:9981:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9981:1869977659519872:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349935.148967:0:9981:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349935.152086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.152219:0:9981:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9981:1869977659519872:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349935.152265:0:9981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 12 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.152310:0:9981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031800, rc 0) 00000100:00100000:3.0:1783349935.152389:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+12:12441:x1869977642702464:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 3758us (3963us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.152400:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 74 00000100:00100000:2.0:1783349935.153047:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642702592 00000100:00100000:2.0:1783349935.153058:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642702592 00010000:00010000:2.0:1783349935.153104:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e307c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded214 expref: 12 pid: 13811 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.153187:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:2.0:1783349935.153197:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+12:2400:x1869977642702592:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349935.153217:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349935.153245:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e307c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded214 expref: 12 pid: 13811 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.153261:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e307c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded214 expref: 12 pid: 13811 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.153310:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a993d6f/0xd05e6ae1590e307c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded214 expref: 12 pid: 13811 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.153329:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349935.153334:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349935.153343:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 11 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.153355:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 11 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.153400:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 11 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.153436:0:6504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1869977659520000:192.168.203.50@tcp:105: 00000100:00100000:2.0:1783349935.153531:0:6504:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963000 going to sleep for 11 seconds 00000100:00100000:2.0:1783349935.157463:0:6504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1869977659520000:192.168.203.50@tcp:105: 00010000:00010000:2.0:1783349935.157500:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349935.157589:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+11:2400:x1869977642702592:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 4392us (5515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.157604:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:0.0:1783349935.160938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.161046:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642702720 00000100:00100000:2.0:1783349935.161060:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642702720 00002000:00100000:2.0:1783349935.161127:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8ea24477a300 x1869977642702720/t0(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:686/0 lens 504/0 e 0 to 0 dl 1783349946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783349935.161175:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea24477a300 with x1869977642702720 ext(0->12) 00002000:00010000:2.0:1783349935.161182:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea24477a300 00000100:00100000:2.0:1783349935.161218:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:2.0:1783349935.161230:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:689af055-7605-419d-81ba-26cff8cb556b+11:2399:x1869977642702720:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783349935.163033:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:689af055-7605-419d-81ba-26cff8cb556b+13:2399:x1869977642702720:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 Request processed in 1789us (2092us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1783349935.163050:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00002000:00100000:2.0:1783349935.163063:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8ea24477a300 x1869977642702720/t4294967321(0) o4->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:686/0 lens 504/448 e 0 to 0 dl 1783349946 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783349935.163074:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea24477a300 with x1869977642702720 ext(0->12) 00002000:00010000:2.0:1783349935.163080:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea24477a300 00000100:00100000:0.0:1783349935.166854:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.166978:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642702848 00000100:00100000:2.0:1783349935.166993:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642702848 00000100:00100000:2.0:1783349935.167074:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 244 00000100:00100000:2.0:1783349935.167085:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+74:12441:x1869977642702848:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783349935.170237:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:2.0:1783349935.170255:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00010000:00010000:3.0:1783349935.170434:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170466:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170472:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170478:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.170482:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170489:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170504:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ea36d07f000) 00010000:00010000:3.0:1783349935.170516:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349935.170530:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170537:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b600/0xd05e6ae1590e2d88 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170568:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170575:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170581:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170585:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.170594:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170600:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170607:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ea370dce000) 00010000:00010000:3.0:1783349935.170610:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349935.170613:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170618:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e2e30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170634:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170640:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170645:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170650:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8dc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.170652:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170658:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170665:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea24311d800) 00010000:00010000:3.0:1783349935.170667:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349935.170681:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170686:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8dc00/0xd05e6ae1590e2eae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170698:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170704:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170709:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170714:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.170717:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170721:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170728:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea24311d800) 00010000:00010000:3.0:1783349935.170730:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349935.170732:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170738:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6000/0xd05e6ae1590e2ed1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170751:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170766:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170785:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170789:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.170792:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170797:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170806:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349935.170808:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349935.170810:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170816:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a000/0xd05e6ae1590e2fa3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170829:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170836:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170841:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170845:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.170854:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170860:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170868:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:3.0:1783349935.170870:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783349935.170873:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.170879:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6800/0xd05e6ae1590e3060 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349935.171377:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:1.0:1783349935.178915:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659520128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783349935.178996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349935.179069:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659520128 00000100:00100000:3.0:1783349935.179076:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659520128 00000100:00100000:3.0:1783349935.179121:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783349935.179129:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1869977659520128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783349935.179183:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1783349935.179206:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.179228:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000041a2bfe/0xd05e6ae1590e2e3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded173 expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.179238:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1783349935.179242:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349935.179247:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.179299:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000041a2bfe/0xd05e6ae1590e2e3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded173 expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.179313:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000041a2bfe/0xd05e6ae1590e2e3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded173 expref: 12 pid: 8431 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349935.179324:0:8433:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1869977659520256:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349935.179386:0:8433:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1783349935.185549:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1783349935.185573:0:6496:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ea349a5a6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1783349935.185578:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea342d12e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ea349a5ab40 00000020:00080000:2.0:1783349935.185582:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea342d12200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ea243a4f000 00000004:00080000:2.0:1783349935.185604:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1783349935.185626:0:6496:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ea382057cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1783349935.185629:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea345319800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ea382057b40 00000020:00080000:2.0:1783349935.185632:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea345319c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ea243040400 00000100:00100000:2.0:1783349935.185792:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+21:12441:x1869977642702848:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 18705us (18951us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.185803:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 244 00000020:00080000:3.0:1783349935.186268:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1783349935.186337:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1783349935.186360:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349935.186376:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659520512:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783349935.186427:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349935.186465:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659520512 00000100:00100000:3.0:1783349935.186472:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659520512 00000100:00100000:3.0:1783349935.186532:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783349935.186540:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659520512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783349935.186567:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1783349935.186598:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a4bc2ac, atime: 0x6a4bc2ac, ctime: 0x6a4bc2ac, blocks: 0x8 00010000:00010000:3.0:1783349935.186606:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3091 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.186623:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1783349935.186627:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349935.186633:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.186663:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.186687:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.186696:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.186713:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783349935.186843:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659520512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 303us (414us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783349935.186850:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1783349935.186870:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349935.186875:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.186884:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cda00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349935.186888:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.186897:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3091 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.186914:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3091 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.187223:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9821988/0xd05e6ae1590e3091 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.187242:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349935.187244:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349935.187246:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783349935.187254:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783349935.187285:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea244526680/2, rc 0, transno 4294967311 00000100:00100000:3.0:1783349935.187300:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659520512:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783349935.191558:0:8433:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1869977659520256:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349935.191587:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349935.192308:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659520384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783349935.192364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349935.192642:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659520384 00000100:00100000:3.0:1783349935.192649:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659520384 00000100:00100000:3.0:1783349935.192698:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783349935.192706:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1869977659520384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783349935.193025:0:9981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783349935.193029:0:9981:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1783349934 00002000:00010000:3.0:1783349935.193032:0:9981:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783349935.193033:0:9981:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1783349934 -> 1783349934 00002000:00010000:3.0:1783349935.193035:0:9981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783349935.193093:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3647:x1869977659520384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 387us (728us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1783349935.193102:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000004:00080000:2.0:1783349935.193500:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea24477aa00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1783349935.193507:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659520384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783349935.195106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.195329:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642702976 00000100:00100000:2.0:1783349935.195338:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642702976 00010000:00010000:2.0:1783349935.195376:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000041a2bfe/0xd05e6ae1590e2e3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded173 expref: 13 pid: 8431 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.195418:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00100000:2.0:1783349935.195442:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+13:2400:x1869977642702976:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349935.195459:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349935.195465:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000041a2bfe/0xd05e6ae1590e2e3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded173 expref: 13 pid: 8431 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.195481:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000041a2bfe/0xd05e6ae1590e2e3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded173 expref: 13 pid: 8431 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.195503:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000041a2bfe/0xd05e6ae1590e2e3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded173 expref: 13 pid: 8431 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.195520:0:13183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349935.195525:0:13183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349935.195531:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.195541:0:13183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.195568:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349935.195708:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.195719:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.195729:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.195737:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.195757:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783349935.195938:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3646:x1869977659520128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16808us (16941us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1783349935.195947:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1783349935.195970:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349935.195976:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.195985:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349935.195989:0:7458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.195998:0:7458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.196026:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.196034:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e308a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.196052:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349935.196054:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349935.196056:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783349935.201542:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea244778e00/2, rc 0, transno 4294967323 00000100:00100000:0.0:1783349935.201559:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659520128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783349935.202717:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+12:2400:x1869977642702976:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 7270us (7610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.202730:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00100000:1.0:1783349935.212418:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.212499:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642703104 00000100:00100000:3.0:1783349935.212509:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642703104 00000100:00100000:3.0:1783349935.212575:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:3.0:1783349935.212585:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36df4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+12:2399:x1869977642703104:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1783349935.227579:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1783349935.227601:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1783349935.227815:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36df4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+7:2399:x1869977642703104:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 15221us (15395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.227828:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:2.0:1783349935.231333:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349935.234028:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642703360 00000100:00100000:0.0:1783349935.234052:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642703360 00000100:00100000:0.0:1783349935.234218:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 245 00000100:00100000:0.0:1783349935.234232:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+21:12441:x1869977642703360:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783349935.234324:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349935.234360:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7e00/0xd05e6ae1590e3075 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded20d expref: 21 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.234385:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:0.0:1783349935.234390:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349935.234431:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.234447:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.234457:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349935.234626:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000359fc917 reply state 00000000ee1f444e transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.234641:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.234647:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:0.0:1783349935.234650:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783349935.234669:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349935.234810:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+22:12441:x1869977642703360:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 580us (3485us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1783349935.234819:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 245 00000100:00100000:1.0:1783349935.238159:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.238256:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642703488 00000100:00100000:3.0:1783349935.238280:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642703488 00000100:00100000:3.0:1783349935.238351:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:3.0:1783349935.238361:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+7:2399:x1869977642703488:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783349935.238503:0:13811:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783349935.238507:0:13811:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1783349934 -> 1783349933 00002000:00010000:3.0:1783349935.238509:0:13811:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1783349932 00002000:00010000:3.0:1783349935.238511:0:13811:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1783349934 -> 1783349933 00002000:00010000:3.0:1783349935.238527:0:13811:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1783349935.238606:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642703488:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 247us (483us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1783349935.238614:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:2.0:1783349935.253265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.255667:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642703744 00000100:00100000:3.0:1783349935.255689:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642703744 00000100:00100000:3.0:1783349935.255831:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 246 00000100:00100000:3.0:1783349935.255846:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+22:12441:x1869977642703744:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783349935.255960:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.255980:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ff expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.255991:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.256041:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ff expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.256057:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ff expref: 22 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349935.256078:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1869977659520640:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349935.260893:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349935.264274:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1869977659520640:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349935.264338:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.265733:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.265963:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642703872 00000100:00100000:3.0:1783349935.265975:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642703872 00010000:00010000:3.0:1783349935.266026:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ff expref: 23 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349935.266083:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 102 00000100:00100000:3.0:1783349935.266199:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+23:2399:x1869977642703872:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349935.266219:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349935.266228:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ff expref: 23 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.266244:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ff expref: 23 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.266272:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030800/0xd05e6ae1590e3059 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ff expref: 23 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.266307:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:3.0:1783349935.266313:0:7459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.266326:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.266681:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.276233:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349935.276370:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+22:2399:x1869977642703872:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 10266us (10639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.276385:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 102 00010000:00010000:3.0:1783349935.276856:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.276886:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.276952:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.276959:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.276967:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.276972:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cda00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.276978:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.276985:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.277005:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:3.0:1783349935.277009:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783349935.277013:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.277020:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e309f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349935.277093:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+21:12441:x1869977642703744:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 Request processed in 21250us (23843us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783349935.277103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 246 00000100:00100000:2.0:1783349935.281092:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.281456:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642704000 00000100:00100000:3.0:1783349935.281470:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642704000 00000100:00100000:3.0:1783349935.281562:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:3.0:1783349935.281575:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642704000:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783349935.281897:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.281927:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 8 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.281939:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783349935.281945:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349935.281951:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.282005:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 8 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.282022:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 8 pid: 9981 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349935.282040:0:8433:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1869977659520768:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783349935.282473:0:8433:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349935.293325:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.293537:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642704128 00000100:00100000:2.0:1783349935.293551:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642704128 00010000:00010000:2.0:1783349935.293605:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 9 pid: 9981 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.293671:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 103 00000100:00100000:2.0:1783349935.293682:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642704128:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349935.293703:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349935.293729:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 9 pid: 9981 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.293747:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 9 pid: 9981 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.293793:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349935.293798:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349935.293806:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.293818:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.293870:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349935.293943:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689af055-7605-419d-81ba-26cff8cb556b+9:2399:x1869977642704128:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 261us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.293952:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 103 00010000:00010000:3.0:1783349935.295450:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e53889c/0xd05e6ae1590e3083 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded21b expref: 8 pid: 9981 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349935.295477:0:8433:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1869977659520768:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349935.295825:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.295840:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.295848:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.295887:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.295897:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.295905:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.295913:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783349935.295918:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.295927:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.295949:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.295964:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015eba661/0xd05e6ae1590e30a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349935.296681:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+7:2399:x1869977642704000:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 15102us (15596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.296693:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:1.0:1783349935.301828:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.302285:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642704384 00000100:00100000:2.0:1783349935.302307:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642704384 00000100:00100000:2.0:1783349935.302501:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 247 00000100:00100000:2.0:1783349935.304015:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+21:12441:x1869977642704384:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783349935.304169:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.304191:0:12147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c7 expref: 21 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.304201:0:12147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.304247:0:12147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c7 expref: 21 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.306472:0:12147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c7 expref: 21 pid: 8582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.306726:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659520896:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349935.307092:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963000 going to sleep for 11 seconds 00000100:00100000:1.0:1783349935.314921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.315083:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642704512 00000100:00100000:3.0:1783349935.315098:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642704512 00010000:00010000:3.0:1783349935.315186:0:13183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c7 expref: 22 pid: 8582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349935.315234:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 104 00000100:00100000:3.0:1783349935.315246:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+22:2399:x1869977642704512:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349935.315267:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349935.315274:0:13183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c7 expref: 22 pid: 8582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.315299:0:13183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c7 expref: 22 pid: 8582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.316447:0:13183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349935.316466:0:13183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ffe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ea expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.316481:0:13183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.316736:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e2f9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1c7 expref: 22 pid: 8582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.316904:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659520896:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783349935.316958:0:13183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.316967:0:13183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.324297:0:12147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.325173:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349935.325307:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:689af055-7605-419d-81ba-26cff8cb556b+21:2399:x1869977642704512:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 10046us (10388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.325323:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 104 00010000:00010000:2.0:1783349935.335637:0:12147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.335660:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.337971:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.338022:0:12147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e3067 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded206 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.338034:0:12147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.338091:0:12147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e3067 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded206 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.338111:0:12147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e3067 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded206 expref: 21 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349935.338167:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659521024:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783349935.338303:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349935.348847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.349023:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642704640 00000100:00100000:2.0:1783349935.349037:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642704640 00010000:00010000:2.0:1783349935.349092:0:7459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e3067 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded206 expref: 22 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.349197:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 105 00000100:00100000:2.0:1783349935.349209:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350949c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+22:2399:x1869977642704640:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349935.349231:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349935.349239:0:7459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e3067 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded206 expref: 22 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.349255:0:7459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e3067 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded206 expref: 22 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.349503:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:2.0:1783349935.349519:0:7459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.349550:0:7459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.349558:0:7459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.349584:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349935.349653:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350949c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:689af055-7605-419d-81ba-26cff8cb556b+22:2399:x1869977642704640:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 446us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.349661:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 105 00010000:00010000:0.0:1783349935.351586:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7400/0xd05e6ae1590e3067 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded206 expref: 21 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349935.351618:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659521024:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783349935.351649:0:12147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.351661:0:12147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.351689:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349935.351973:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1783349935.352122:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1783349935.354036:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1783349935.356400:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12147:1869977659521152:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783349935.356520:0:12147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349935.356575:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349935.357185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659521152 00000100:00100000:3.0:1783349935.357201:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659521152 00000100:00100000:3.0:1783349935.357298:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783349935.357311:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12147:x1869977659521152:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783349935.357475:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12147:x1869977659521152:12345-0@lo:1000:mdt00_004.0 Request processed in 166us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.357483:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783349935.358942:0:12147:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1783349935.358956:0:12147:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:0.0:1783349935.359005:0:12147:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea24477aa00, transno 4294967322 00000004:00080000:0.0:1783349935.359029:0:12147:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea244778e00, transno 4294967323 00000100:00100000:0.0:1783349935.359039:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12147:1869977659521152:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1783349935.359480:0:12147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1783349935.361103:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12147:1869977659521280:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783349935.361231:0:12147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349935.361397:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349935.361772:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659521280 00000100:00100000:2.0:1783349935.361783:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659521280 00000100:00100000:2.0:1783349935.361852:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783349935.361862:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:12147:x1869977659521280:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783349935.362034:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12147:x1869977659521280:12345-0@lo:1000:mdt00_004.0 Request processed in 173us (803us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1783349935.362043:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783349935.362578:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12147:1869977659521280:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1783349935.362645:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362657:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362665:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362697:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364bc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349935.362702:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362710:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362729:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:0.0:1783349935.362732:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349935.362736:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362743:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364bc00/0xd05e6ae1590e30b4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362904:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362910:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362917:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362921:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783349935.362924:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362930:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362948:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:0.0:1783349935.362950:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349935.362957:0:12147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ffe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ea expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362970:0:12147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ffe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ea expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.362980:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ffe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ea expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.363014:0:12147:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ffe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ea expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349935.363028:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659521408:192.168.203.50@tcp:105: 00000100:00100000:0.0:1783349935.363115:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3582b8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349935.372432:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.373695:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642704768 00000100:00100000:2.0:1783349935.373712:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642704768 00000100:00100000:2.0:1783349935.373804:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:2.0:1783349935.373816:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+25:12440:x1869977642704768:12345-192.168.203.50@tcp:49:lfs.0 00000100:00100000:2.0:1783349935.373994:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+25:12440:x1869977642704768:12345-192.168.203.50@tcp:49:lfs.0 Request processed in 180us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.374003:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:1.0:1783349935.388684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.388880:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642705024 00000100:00100000:2.0:1783349935.388894:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642705024 00000100:00100000:2.0:1783349935.388976:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 248 00000100:00100000:2.0:1783349935.389008:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+25:12440:x1869977642705024:12345-192.168.203.50@tcp:58:lfs.0 00000040:00080000:3.0:1783349935.389737:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1783349935.390483:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+25:12440:x1869977642705024:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 1468us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.390496:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 248 00000100:00100000:0.0:1783349935.394374:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659521408:192.168.203.50@tcp:105: 00010000:00010000:0.0:1783349935.394421:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349935.394435:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e2ff7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.402100:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403108:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403158:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403401:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403410:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30bb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403418:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403425:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.403430:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403439:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30bb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403455:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349935.403459:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349935.403464:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30bb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403470:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30bb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403493:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403499:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403505:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403591:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6e00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783349935.403594:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403600:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403609:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349935.403611:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783349935.403614:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.403619:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6e00/0xd05e6ae1590e30ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.409729:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+24:12441:x1869977642704384:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 107200us (107896us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1783349935.409747:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 247 00000020:00080000:2.0:1783349935.409762:0:12147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1783349935.418775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.418990:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642705280 00000100:00100000:3.0:1783349935.419018:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642705280 00000100:00100000:3.0:1783349935.419093:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:3.0:1783349935.419106:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350804450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+24:12441:x1869977642705280:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783349935.419719:0:6521:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783349935.419928:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1783349935.419977:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.419999:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.420014:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.420046:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.420054:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.420060:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.420088:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349935.420966:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349935.420979:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.420990:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783349935.420994:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.421004:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.421024:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:1.0:1783349935.421039:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783349935.421046:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.421052:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30c2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.421072:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349935.421074:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349935.421076:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349935.421481:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350804450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+26:12441:x1869977642705280:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 2371us (2725us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1783349935.421493:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00000020:00080000:3.0:1783349935.421501:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1783349935.422886:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349935.422898:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349935.422952:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783349935.422962:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783349935.431465:0:13790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659521536:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783349935.435160:0:13790:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963240 going to sleep for 11 seconds 00000100:00100000:1.0:1783349935.443382:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.444064:0:13790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13790:1869977659521536:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783349935.445555:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642705408 00000100:00100000:3.0:1783349935.445573:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642705408 00000100:00100000:3.0:1783349935.445658:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 249 00000100:00100000:3.0:1783349935.445668:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+26:12445:x1869977642705408:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783349935.445715:0:6517:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783349935.445866:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+26:12445:x1869977642705408:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 199us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.445874:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 249 00000100:00100000:1.0:1783349935.450489:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.450917:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642705664 00000100:00100000:3.0:1783349935.450931:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642705664 00000100:00100000:3.0:1783349935.451017:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 250 00000100:00100000:3.0:1783349935.451029:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+26:12445:x1869977642705664:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349935.451057:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349935.451102:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e30c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded222 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.451302:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.451320:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.451423:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349935.451439:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783349935.453986:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e30c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded222 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.454030:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded222 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.454041:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349935.454044:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783349935.454049:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc200, rc 0) 00000100:00100000:3.0:1783349935.454178:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+28:12445:x1869977642705664:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 3149us (3704us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1783349935.454192:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 250 00000100:00100000:3.0:1783349935.456844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.459426:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642705792 00000100:00100000:2.0:1783349935.459591:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642705792 00000100:00100000:2.0:1783349935.459677:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 251 00000100:00100000:2.0:1783349935.459689:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+28:12443:x1869977642705792:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349935.459712:0:12147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349935.459734:0:12147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e30de lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded229 expref: -99 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.459800:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e30e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.459815:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e30e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.459828:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e30e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.459859:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e30ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.459867:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e30ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.459873:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e30ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.459972:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.459984:0:12147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1e3 expref: 29 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.459992:0:12147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.460026:0:12147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1e3 expref: 29 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.460039:0:12147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1e3 expref: 29 pid: 8582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.460052:0:12147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659521664:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783349935.460175:0:12147:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea243963240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349935.460773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.461184:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642706048 00000100:00100000:2.0:1783349935.461192:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642706048 00000100:00100000:2.0:1783349935.461248:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 252 00000100:00100000:2.0:1783349935.461269:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+30:12445:x1869977642706048:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783349935.461337:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e30fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.461351:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e30fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.461362:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e30fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.461524:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e30fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.461532:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e30fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.461540:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e30fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.461546:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783349935.461550:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e30fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.461557:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e30fa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.461569:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:2.0:1783349935.461572:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783349935.461576:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e30fa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349935.461582:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7000/0xd05e6ae1590e30fa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.461735:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+31:12445:x1869977642706048:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 464us (960us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1783349935.461748:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 252 00000040:00080000:2.0:1783349935.461835:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349935.461840:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349935.462345:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783349935.462354:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783349935.479545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.480482:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642706304 00000100:00100000:2.0:1783349935.480496:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642706304 00000100:00100000:2.0:1783349935.480565:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:2.0:1783349935.480575:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+31:12445:x1869977642706304:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783349935.480810:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+32:12445:x1869977642706304:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 235us (1272us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1783349935.480818:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:1.0:1783349935.489602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349935.489743:0:12147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12147:1869977659521664:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783349935.489770:0:12147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349935.492324:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349935.492346:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659521792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349935.492406:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349935.492462:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659521792 00000100:00100000:2.0:1783349935.492469:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659521792 00000100:00100000:2.0:1783349935.492513:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783349935.492522:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1869977659521792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349935.492567:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783349935.492611:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1869977659521792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.492618:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783349935.492663:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659521792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349935.496489:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349935.496513:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659521920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349935.496580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349935.496636:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659521920 00000100:00100000:2.0:1783349935.496643:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659521920 00000100:00100000:2.0:1783349935.496687:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783349935.496694:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659521920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783349935.496717:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783349935.496759:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659521920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349935.496765:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783349935.496806:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659521920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349935.500448:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642706560 00000100:00100000:0.0:1783349935.500464:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642706560 00000100:00100000:0.0:1783349935.500556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:0.0:1783349935.500566:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+32:6164:x1869977642706560:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783349935.500789:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+33:6164:x1869977642706560:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 223us (11195us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1783349935.500796:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:0.0:1783349935.507570:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.508196:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642706688 00000100:00100000:3.0:1783349935.508207:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642706688 00010000:00010000:3.0:1783349935.508260:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1e3 expref: 33 pid: 8582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349935.508317:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 106 00000100:00100000:3.0:1783349935.508333:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+33:2399:x1869977642706688:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349935.508349:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349935.508356:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1e3 expref: 33 pid: 8582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.508369:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1e3 expref: 33 pid: 8582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.508391:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c600/0xd05e6ae1590e2fe9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1e3 expref: 33 pid: 8582 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.508408:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:3.0:1783349935.508413:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.508424:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.508431:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349935.508464:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349935.508511:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689af055-7605-419d-81ba-26cff8cb556b+32:2399:x1869977642706688:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 187us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.508519:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 106 00010000:00010000:1.0:1783349935.509470:0:12147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509483:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349935.509672:0:12147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783349935.509677:0:12147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783349935.509700:0:12147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509715:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509725:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e30e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509732:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e30e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509758:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e30e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509764:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7c00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349935.509768:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e30e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509775:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e30e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509787:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:1.0:1783349935.509790:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349935.509794:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e30e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509799:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e30e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509819:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e30ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509825:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e30ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509830:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e30ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509834:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6a00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349935.509837:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e30ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509851:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e30ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509859:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ea2424c6400) 00010000:00010000:1.0:1783349935.509861:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349935.509864:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e30ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509869:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6a00/0xd05e6ae1590e30ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509910:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6600/0xd05e6ae1590e30de lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded229 expref: 32 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509923:0:12147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded229 expref: 31 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349935.509930:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:1.0:1783349935.509932:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349935.509934:0:12147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7800, rc 0) 00000100:00100000:1.0:1783349935.509997:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+31:12443:x1869977642705792:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 50310us (53167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349935.510005:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 251 00000100:00100000:0.0:1783349935.708300:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349935.708346:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349935.708393:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.708405:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642706816 00000100:00100000:0.0:1783349935.708431:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642707328 00000100:00100000:3.0:1783349935.708437:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642706816 00000100:00100000:0.0:1783349935.708444:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642707328 00000100:00100000:3.0:1783349935.708532:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 385 00000100:00100000:3.0:1783349935.708546:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642706816:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349935.708643:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2400:x1869977642706816:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 98us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349935.708644:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 308 00000100:00100000:3.0:1783349935.708659:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 385 00000100:00100000:0.0:1783349935.708667:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642707328:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349935.708785:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642707072 00000100:00100000:2.0:1783349935.708790:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642707072 00000100:00100000:2.0:1783349935.708834:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:2.0:1783349935.708843:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642707072:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349935.708890:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642707328:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 231us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349935.708898:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 308 00000100:00080000:0.0:1783349935.708921:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349935.708926:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783349935.714355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.714429:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349935.714494:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642706944 00000100:00100000:3.0:1783349935.715077:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642706944 00000100:00100000:3.0:1783349935.715197:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642707200 00000100:00100000:3.0:1783349935.715202:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642707200 00000100:00100000:3.0:1783349935.715231:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 309 00000100:00100000:3.0:1783349935.715254:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642706944:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349935.715362:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2400:x1869977642706944:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 121us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.715371:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 309 00000100:00100000:3.0:1783349935.715391:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 310 00000100:00100000:3.0:1783349935.715398:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642707200:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349935.715448:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2400:x1869977642707200:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 50us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349935.715455:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 310 00000100:00100000:2.0:1783349935.715474:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+7:2400:x1869977642707072:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 6619us (7115us total) trans 0 rc 0/0 00000100:00080000:3.0:1783349935.715480:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783349935.715486:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783349935.715496:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 133 00010000:00010000:3.0:1783349936.005192:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783349936.656494:0:14704:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349936.656509:0:14704:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349936.656542:0:14704:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1783349936.656549:0:14704:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349936.938019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349936.938433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642707584 00000100:00100000:0.0:1783349936.938443:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642707584 00000100:00100000:2.0:1783349936.938673:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 253 00000100:00100000:2.0:1783349936.938698:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+31:12467:x1869977642707584:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783349936.938725:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349936.938744:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e3101 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded230 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349936.938849:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e3108 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349936.938862:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e3108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349936.938876:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e3108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349936.938886:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783349936.939049:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7c00/0xd05e6ae1590e3101 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded230 expref: 34 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349936.939067:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e3108 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded230 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349936.939075:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:2.0:1783349936.939077:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783349936.939081:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6c00, rc 0) 00000100:00100000:2.0:1783349936.939345:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+33:12467:x1869977642707584:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 647us (1332us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1783349936.939353:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 253 00000100:00100000:0.0:1783349936.951596:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349936.952071:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642707712 00000100:00100000:3.0:1783349936.952083:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642707712 00000100:00100000:3.0:1783349936.952186:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 254 00000100:00100000:3.0:1783349936.952197:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+33:12467:x1869977642707712:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1783349936.952292:0:12147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e3116 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349936.952330:0:12147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e3116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349936.952344:0:12147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e3116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349936.952551:0:12147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e3116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349936.952560:0:12147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e3116 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349936.952584:0:12147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e3116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349936.952589:0:12147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349936.952594:0:12147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e3116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349936.952602:0:12147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e3116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349936.952614:0:12147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:1.0:1783349936.952617:0:12147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349936.952621:0:12147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e3116 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349936.952627:0:12147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340031200/0xd05e6ae1590e3116 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349936.952705:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:689af055-7605-419d-81ba-26cff8cb556b+33:12467:x1869977642707712:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 509us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349936.952713:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 254 00010000:00010000:3.0:1783349937.030300:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349937.052020:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349937.061974:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642707840 00000100:00100000:3.0:1783349937.062002:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642707840 00000100:00100000:2.0:1783349937.062450:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:2.0:1783349937.062467:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642707840:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:2.0:1783349937.062504:0:9981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349937.062523:0:9981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e311d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded237 expref: -99 pid: 9981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349937.062547:0:9981:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a4bc2ad, atime: 0x6a4bc2ac, ctime: 0x6a4bc2ad, blocks: 0x8 00010000:00010000:2.0:1783349937.062566:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1783349937.062570:0:9981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349937.062579:0:9981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e311d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded237 expref: 8 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349937.062596:0:9981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e311d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded237 expref: 8 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349937.062609:0:9981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7c00, rc 0) 00000100:00100000:2.0:1783349937.062673:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+8:2402:x1869977642707840:12345-192.168.203.50@tcp:101:cat.0 Request processed in 207us (10663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349937.062680:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00080000:3.0:1783349937.064331:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349937.077406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349937.077626:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642707968 00000100:00100000:0.0:1783349937.077636:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642707968 00002000:00100000:0.0:1783349937.077697:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8ea244524700 x1869977642707968/t0(0) o3->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:688/0 lens 488/0 e 0 to 0 dl 1783349948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783349937.077708:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea244524700 with x1869977642707968 ext(0->4095) 00002000:00010000:0.0:1783349937.077732:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea244524700 00000100:00100000:0.0:1783349937.077789:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1783349937.077804:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642707968:12345-192.168.203.50@tcp:3:cat.0 00000100:00100000:0.0:1783349937.078169:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642707968:12345-192.168.203.50@tcp:3:cat.0 Request processed in 332us (737us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783349937.078177:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00002000:00100000:0.0:1783349937.078185:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8ea244524700 x1869977642707968/t0(0) o3->689af055-7605-419d-81ba-26cff8cb556b@192.168.203.50@tcp:688/0 lens 488/4536 e 0 to 0 dl 1783349948 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783349937.078192:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ea244524700 with x1869977642707968 ext(0->4095) 00002000:00010000:0.0:1783349937.078195:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ea244524700 00000100:00100000:0.0:1783349937.540697:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659522048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349937.540770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349937.541599:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659522048 00000100:00100000:2.0:1783349937.541610:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659522048 00000100:00100000:2.0:1783349937.541670:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783349937.541679:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659522048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783349937.541714:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783349937.541780:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659522048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349937.541786:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783349937.542263:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659522048:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783349938.052407:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349939.076519:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659522176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349939.076594:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.076646:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349939.076653:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659522304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349939.076679:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349939.076715:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349939.076729:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659522176 00000100:00100000:2.0:1783349939.076736:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659522176 00000100:00100000:2.0:1783349939.076778:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783349939.076786:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659522176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783349939.076820:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349939.076864:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659522176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.076872:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783349939.076893:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659522304 00000100:00100000:2.0:1783349939.076896:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659522304 00000100:00100000:2.0:1783349939.076926:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783349939.076933:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659522304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349939.076950:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783349939.076977:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659522304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.076982:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1783349939.076999:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349939.077034:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659522304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349939.077047:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659522176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349939.079960:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659522432:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.080035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.081433:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659522944:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.082571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.082608:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659523456:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.082644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.082669:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783349939.082676:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659522560:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.082697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.082713:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659523072:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.082731:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.082747:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659523584:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.082763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.082801:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659522432 00000100:00100000:2.0:1783349939.082808:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659522432 00000100:00100000:2.0:1783349939.082855:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1783349939.082863:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659522432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.082911:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659522432:12345-0@lo:400:kworker.0 Request processed in 49us (2877us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.082918:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1783349939.082949:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659522944 00000100:00100000:2.0:1783349939.082952:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659522944 00000100:00100000:2.0:1783349939.085593:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659523456 00000100:00100000:2.0:1783349939.085608:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659523456 00000100:00100000:2.0:1783349939.085650:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659522560 00000100:00100000:2.0:1783349939.085654:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659522560 00000100:00100000:2.0:1783349939.085665:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659523072 00000100:00100000:2.0:1783349939.085668:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659523072 00000100:00100000:2.0:1783349939.085682:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659523584 00000100:00100000:2.0:1783349939.085685:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659523584 00000100:00100000:2.0:1783349939.085716:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1783349939.085724:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659522944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.085801:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659522944:12345-0@lo:400:kworker.0 Request processed in 78us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.085809:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1783349939.085824:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1783349939.085830:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659523456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.085856:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659523456:12345-0@lo:400:kworker.0 Request processed in 27us (3212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.085862:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1783349939.085872:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1783349939.085877:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659522560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.085901:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659522560:12345-0@lo:400:kworker.0 Request processed in 24us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.085906:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1783349939.085915:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1783349939.085920:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659523072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.085942:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659523072:12345-0@lo:400:kworker.0 Request processed in 22us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.085947:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1783349939.085956:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1783349939.085962:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659523584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.085998:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659523584:12345-0@lo:400:kworker.0 Request processed in 36us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.086004:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1783349939.090351:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659522816:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.090420:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.090453:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659523328:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.090486:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.090505:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659523840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349939.090525:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.090546:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783349939.090551:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659522688:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.090573:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.090587:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659523200:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.090604:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.090619:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659523712:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.090634:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349939.090662:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659523328 00000100:00100000:2.0:1783349939.090669:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659523328 00000100:00100000:2.0:1783349939.090710:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659523200 00000100:00100000:2.0:1783349939.090714:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659523200 00000100:00100000:2.0:1783349939.090731:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659523712 00000100:00100000:2.0:1783349939.090733:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659523712 00000100:00100000:2.0:1783349939.090748:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783349939.090757:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659523328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.090806:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659523328:12345-0@lo:400:kworker.0 Request processed in 49us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.090813:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783349939.090827:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783349939.090832:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659523200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.090872:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659523200:12345-0@lo:400:kworker.0 Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.090877:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783349939.090887:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783349939.090893:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659523712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.090916:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659523712:12345-0@lo:400:kworker.0 Request processed in 24us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.090922:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783349939.090939:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659523840 00000100:00100000:2.0:1783349939.090942:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659523840 00000100:00100000:2.0:1783349939.090962:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783349939.090967:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659523840:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349939.091341:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659522816 00000100:00100000:0.0:1783349939.091346:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659522816 00000100:00100000:0.0:1783349939.091375:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1783349939.091381:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659522816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349939.091418:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659522816:12345-0@lo:400:kworker.0 Request processed in 37us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349939.091424:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1783349939.095638:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659522688 00000100:00100000:0.0:1783349939.095661:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659522688 00000100:00100000:0.0:1783349939.095737:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783349939.095750:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659522688:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1783349939.096362:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783349939.096467:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659523200:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.096491:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659523712:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.096505:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659522816:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.096517:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659523328:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.096610:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659523840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5641us (6083us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349939.096620:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783349939.096659:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659523840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349939.098295:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659522688:12345-0@lo:400:kworker.0 Request processed in 2533us (7705us total) trans 0 rc 0/0 00000100:00080000:1.0:1783349939.098300:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349939.098310:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783349939.098314:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783349939.098317:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349939.098339:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783349939.098379:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659522560:0@lo:400:kworker.0 00010000:00080000:1.0:1783349939.098405:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea244777b80 x1869977659523072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349939.098435:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659523072:0@lo:400:kworker.0 00010000:00080000:1.0:1783349939.098450:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370d66300 x1869977659523584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349939.098458:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659523584:0@lo:400:kworker.0 00000100:00100000:1.0:1783349939.098468:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659522432:0@lo:400:kworker.0 00000100:00100000:1.0:1783349939.098493:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659522944:0@lo:400:kworker.0 00000100:00100000:1.0:1783349939.098503:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659523456:0@lo:400:kworker.0 00000100:00100000:2.0:1783349939.098688:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659522688:0@lo:400:kworker.0 00000001:00080000:0.0:1783349939.099726:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1783349939.099746:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:3.0:1783349940.100844:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349940.612668:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659523968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349940.612735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349940.613207:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659523968 00000100:00100000:2.0:1783349940.613221:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659523968 00000100:00100000:0.0:1783349940.613268:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659524096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349940.613272:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783349940.613280:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659523968:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349940.613297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1783349940.613306:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349940.613345:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659523968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349940.613350:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783349940.613361:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659523968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349940.613363:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659524096 00000100:00100000:2.0:1783349940.613365:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659524096 00000100:00100000:2.0:1783349940.613377:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783349940.613382:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659524096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349940.613392:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349940.613429:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659524096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349940.613435:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783349940.613520:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1783349940.613526:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1783349940.613540:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea244526680, transno 4294967311 00000100:00100000:0.0:1783349940.613564:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659524096:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1783349940.620232:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1783349940.620308:0:6496:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ea3582b8d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1783349940.620316:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36d9bb400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ea3582b83c0 00000020:00080000:0.0:1783349940.620320:0:6496:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ea36d9bb900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ea345af1200 00000020:00080000:0.0:1783349940.620352:0:6496:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1783349940.620402:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1783349940.620485:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1783349940.621320:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349940.621334:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349940.621342:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349940.621349:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783349940.621354:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349940.621362:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349940.621380:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ea370dce600) 00010000:00010000:1.0:1783349940.621384:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349940.621400:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349940.621406:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a600/0xd05e6ae1590e3098 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349940.829640:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349940.829692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349940.829717:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349940.830173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349940.830197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349940.830219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349940.830253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349940.830284:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642708480 00000100:00100000:1.0:1783349940.830293:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642708480 00000100:00100000:1.0:1783349940.830354:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642708608 00000100:00100000:1.0:1783349940.830357:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642708608 00000100:00100000:1.0:1783349940.830382:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 137 00000100:00100000:1.0:1783349940.830391:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642708480:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349940.830459:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642708480:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 68us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349940.830467:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 137 00000100:00100000:1.0:1783349940.830483:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 138 00000100:00100000:1.0:1783349940.830489:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642708608:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349940.830512:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689af055-7605-419d-81ba-26cff8cb556b+8:2399:x1869977642708608:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349940.830518:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 138 00000100:00100000:1.0:1783349940.830535:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642708224 00000100:00100000:1.0:1783349940.830551:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642708224 00000100:00100000:1.0:1783349940.830578:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642708736 00000100:00100000:1.0:1783349940.830581:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642708736 00000100:00100000:1.0:1783349940.830593:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642708352 00000100:00100000:1.0:1783349940.830595:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642708352 00000100:00100000:1.0:1783349940.830607:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642708864 00000100:00100000:1.0:1783349940.830609:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642708864 00000100:00100000:1.0:1783349940.830621:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 317 00000100:00100000:1.0:1783349940.830627:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+19:2399:x1869977642708224:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349940.830655:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+19:2399:x1869977642708224:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 28us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349940.830661:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 317 00000100:00100000:1.0:1783349940.830672:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 318 00000100:00100000:1.0:1783349940.830677:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642708736:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349940.830698:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642708736:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 21us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349940.830704:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 318 00000100:00100000:1.0:1783349940.830714:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 319 00000100:00100000:1.0:1783349940.830720:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642708352:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349940.830741:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642708352:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349940.830747:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 319 00000100:00100000:1.0:1783349940.830758:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 320 00000100:00100000:1.0:1783349940.830764:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642708864:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349940.830785:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642708864:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 21us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349940.830797:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 320 00000100:00080000:1.0:1783349940.830822:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783349940.830826:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349940.831338:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642708096 00000100:00100000:3.0:1783349940.831345:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642708096 00000100:00100000:3.0:1783349940.831379:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 387 00000100:00100000:3.0:1783349940.831393:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642708096:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783349940.831432:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642708096:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 40us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349940.831438:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 387 00000100:00080000:1.0:1783349940.832273:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349940.832282:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1783349941.127992:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1783349941.128006:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1783349941.141697:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349942.160186:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349942.661349:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349942.661372:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659524224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783349942.661436:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349942.661495:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659524224 00000100:00100000:2.0:1783349942.661502:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659524224 00000100:00100000:2.0:1783349942.661543:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783349942.661551:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659524224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783349942.661583:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783349942.661629:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659524224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349942.661636:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783349942.661673:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659524224:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783349943.174532:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783349943.185645:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783349943.430221:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349943.432459:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642708992 00000100:00100000:1.0:1783349943.432477:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642708992 00000100:00100000:1.0:1783349943.432615:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 255 00000100:00100000:1.0:1783349943.432926:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+19:12128:x1869977642708992:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783349943.435031:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689af055-7605-419d-81ba-26cff8cb556b+19:12128:x1869977642708992:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 Request processed in 2103us (4809us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349943.435044:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 255 00000100:00080000:2.0:1783349943.435934:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349943.447937:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349943.448994:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642709120 00000100:00100000:1.0:1783349943.449016:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642709120 00000100:00100000:1.0:1783349943.449096:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 256 00000100:00100000:1.0:1783349943.449108:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:12128:x1869977642709120:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783349943.449259:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:12128:x1869977642709120:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 Request processed in 153us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349943.449266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 256 00000100:00080000:2.0:1783349943.449561:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349943.458564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349943.458723:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642709376 00000100:00100000:2.0:1783349943.458734:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642709376 00000100:00100000:2.0:1783349943.458791:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:2.0:1783349943.458801:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+19:12128:x1869977642709376:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783349943.459084:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689af055-7605-419d-81ba-26cff8cb556b+20:12128:x1869977642709376:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 284us (529us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1783349943.459092:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00000040:00080000:2.0:1783349943.684338:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349943.684348:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349943.684429:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783349943.684436:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783349943.824479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349943.824572:0:8582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642709504 00000100:00100000:1.0:1783349943.824582:0:8582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642709504 00000100:00100000:1.0:1783349943.824645:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 257 00000100:00100000:1.0:1783349943.824654:0:8582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:12926:x1869977642709504:12345-192.168.203.50@tcp:101:lsof.0 00010000:00010000:1.0:1783349943.824687:0:8582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349943.824706:0:8582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e3124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded23e expref: -99 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349943.824765:0:8582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e312b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349943.824776:0:8582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e312b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349943.824788:0:8582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e312b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349943.824844:0:8582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783349943.824847:0:8582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783349943.824870:0:8582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e312b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349943.824893:0:8582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e3124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded23e expref: 7 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349943.824912:0:8582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e312b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded23e expref: 6 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349943.824920:0:8582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5d00) 00010000:00010000:1.0:1783349943.824923:0:8582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349943.824926:0:8582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8cc00, rc 0) 00000100:00100000:1.0:1783349943.824994:0:8582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:12926:x1869977642709504:12345-192.168.203.50@tcp:101:lsof.0 Request processed in 341us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349943.825002:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 257 00000100:00080000:2.0:1783349943.827068:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349944.196403:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659524352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349944.196470:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349944.196733:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349944.196744:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659524480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349944.196776:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349944.196804:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659524480 00000100:00100000:0.0:1783349944.196810:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659524480 00000100:00100000:0.0:1783349944.196870:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783349944.196880:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659524480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783349944.196908:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783349944.196968:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659524480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349944.196980:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783349944.197021:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659524608:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197058:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349944.197072:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659524736:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197086:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659525120:0@lo:400:kworker.0 00000100:00100000:3.0:1783349944.197115:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349944.197127:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659524608 00000100:00100000:0.0:1783349944.197132:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659524608 00000100:00100000:3.0:1783349944.197170:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659525248:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197195:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1783349944.197203:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659524608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349944.197213:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349944.197246:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659525760:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197253:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659524608:12345-0@lo:400:kworker.0 Request processed in 50us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349944.197261:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1783349944.197273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783349944.197293:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349944.197299:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783349944.197307:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659524864:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349944.197341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349944.197362:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659525376:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197367:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659524480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349944.197388:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659525632:0@lo:400:kworker.0 00000100:00100000:3.0:1783349944.197393:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349944.197419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349944.197425:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659525888:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197455:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659524608:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197466:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783349944.197471:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659524992:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197492:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349944.197502:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659525504:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349944.197553:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659524736 00000100:00100000:0.0:1783349944.197564:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659524736 00000100:00100000:0.0:1783349944.197584:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659525248 00000100:00100000:0.0:1783349944.197586:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659525248 00000100:00100000:0.0:1783349944.197603:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659525760 00000100:00100000:0.0:1783349944.197605:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659525760 00000100:00100000:3.0:1783349944.197622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349944.197623:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659525120 00000100:00100000:0.0:1783349944.197627:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659525120 00000100:00100000:0.0:1783349944.197642:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659525632 00000100:00100000:0.0:1783349944.197644:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659525632 00000100:00100000:3.0:1783349944.197661:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659524352 00000100:00100000:0.0:1783349944.197661:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659524992 00000100:00100000:0.0:1783349944.197666:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659524992 00000100:00100000:3.0:1783349944.197667:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659524352 00000100:00100000:0.0:1783349944.197682:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1783349944.197691:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659524736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197728:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659524736:12345-0@lo:400:kworker.0 Request processed in 40us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349944.197734:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1783349944.197747:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783349944.197753:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659525248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349944.197767:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659524864 00000100:00100000:3.0:1783349944.197772:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659524864 00000100:00100000:0.0:1783349944.197781:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659525248:12345-0@lo:400:kworker.0 Request processed in 27us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349944.197792:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1783349944.197803:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783349944.197810:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1783349944.197814:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659524352:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349944.197822:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659525760:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1783349944.197840:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783349944.197854:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659525760:12345-0@lo:400:kworker.0 Request processed in 35us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349944.197862:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1783349944.197877:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783349944.197883:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659524352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349944.197887:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659525120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349944.197895:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783349944.197913:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783349944.197920:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659524864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.197940:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659525120:12345-0@lo:400:kworker.0 Request processed in 56us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349944.197947:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783349944.197960:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659524864:12345-0@lo:400:kworker.0 Request processed in 40us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349944.197967:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783349944.197971:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783349944.197978:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659525632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349944.197997:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1783349944.198214:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659525376 00000100:00100000:2.0:1783349944.198228:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659525376 00000100:00100000:2.0:1783349944.198255:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659525504 00000100:00100000:2.0:1783349944.198258:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659525504 00000100:00100000:2.0:1783349944.198273:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659525888 00000100:00100000:2.0:1783349944.198275:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659525888 00010000:00010000:1.0:1783349944.198745:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349944.198798:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659525632:12345-0@lo:400:kworker.0 Request processed in 36us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349944.198807:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:0.0:1783349944.198831:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349944.198835:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349944.198838:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783349944.198851:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783349944.198882:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659525632:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.198895:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659525120:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.198907:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349944.198915:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659526016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349944.198950:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349944.199058:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659524864:0@lo:400:kworker.0 00000100:00100000:0.0:1783349944.199075:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659524736:0@lo:400:kworker.0 00010000:00080000:0.0:1783349944.199087:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea244526d80 x1869977659525248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349944.199098:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659525248:0@lo:400:kworker.0 00010000:00080000:0.0:1783349944.199109:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea379138380 x1869977659525760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349944.199149:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659525760:0@lo:400:kworker.0 00000100:00100000:2.0:1783349944.202389:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783349944.202417:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659525376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349944.202513:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659525376:12345-0@lo:400:kworker.0 Request processed in 109us (5121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349944.202970:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783349944.202994:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659525504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349944.203043:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659525504:12345-0@lo:400:kworker.0 Request processed in 65us (5521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349944.203051:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783349944.203078:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783349944.203086:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659525888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349944.203117:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659525888:12345-0@lo:400:kworker.0 Request processed in 32us (5496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349944.203122:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783349944.203205:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659525504:0@lo:400:kworker.0 00000100:00100000:1.0:1783349944.203295:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659526016 00000100:00100000:1.0:1783349944.203302:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659526016 00000100:00100000:1.0:1783349944.203347:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783349944.203354:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36e13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659526016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349944.203367:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783349944.203402:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36e13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659526016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (4451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349944.203408:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783349944.203637:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1783349944.203643:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1783349944.203663:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659526016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349944.204016:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659525376:0@lo:400:kworker.0 00000100:00100000:1.0:1783349944.204027:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659525888:0@lo:400:kworker.0 00000100:00100000:1.0:1783349944.204098:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659524352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349944.204344:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783349944.208017:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659524992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349944.208183:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659524992:12345-0@lo:400:kworker.0 Request processed in 10177us (10688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349944.208193:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1783349944.208281:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659524992:0@lo:400:kworker.0 00010000:00010000:1.0:1783349945.221376:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349945.732829:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349945.732852:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659526144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349945.732918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349945.732936:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349945.732950:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659526272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349945.732998:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349945.733036:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659526144 00000100:00100000:2.0:1783349945.733044:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659526144 00000100:00100000:2.0:1783349945.733092:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659526272 00000100:00100000:2.0:1783349945.733096:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659526272 00000100:00100000:2.0:1783349945.733112:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783349945.733121:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659526144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349945.733167:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349945.733230:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659526144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349945.733236:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783349945.733252:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783349945.733258:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659526272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783349945.733267:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783349945.733294:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659526272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349945.733300:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783349945.733392:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659526144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349945.733486:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659526272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783349945.958899:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349945.958950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349945.958994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349945.959035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349945.959060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349945.959076:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642709632 00000100:00100000:3.0:1783349945.959090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349945.959094:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642709632 00000100:00100000:3.0:1783349945.959194:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349945.959229:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 389 00000100:00100000:2.0:1783349945.959242:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642709632:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349945.959328:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2402:x1869977642709632:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 90us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349945.959335:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 389 00000100:00100000:1.0:1783349945.959379:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642710144 00000100:00100000:1.0:1783349945.959389:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642710144 00000100:00100000:2.0:1783349945.959419:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642709888 00000100:00100000:2.0:1783349945.959427:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642709888 00000100:00100000:1.0:1783349945.959479:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642710016 00000100:00100000:2.0:1783349945.959483:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642710400 00000100:00100000:1.0:1783349945.959486:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642710016 00000100:00100000:2.0:1783349945.959490:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642710400 00000100:00100000:1.0:1783349945.959536:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:2.0:1783349945.959539:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642709760 00000100:00100000:2.0:1783349945.959546:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642709760 00000100:00100000:1.0:1783349945.959552:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642710144:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349945.959564:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642710272 00000100:00100000:2.0:1783349945.959569:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642710272 00000100:00100000:2.0:1783349945.959590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 327 00000100:00100000:2.0:1783349945.959599:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642709888:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349945.959623:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+7:2402:x1869977642710144:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 75us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349945.959632:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:2.0:1783349945.959649:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642709888:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 47us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349945.959660:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 327 00000100:00100000:1.0:1783349945.959666:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 143 00000100:00100000:1.0:1783349945.959680:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642710016:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349945.959688:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 328 00000100:00100000:2.0:1783349945.959700:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642710400:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349945.959726:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+5:2402:x1869977642710016:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 50us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349945.959742:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 143 00000100:00100000:2.0:1783349945.959743:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2402:x1869977642710400:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 39us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349945.959758:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 328 00000100:00100000:2.0:1783349945.959779:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 329 00000100:00100000:2.0:1783349945.959791:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+20:2402:x1869977642709760:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349945.959798:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 330 00000100:00100000:1.0:1783349945.959810:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2402:x1869977642710272:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783349945.959857:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2402:x1869977642710272:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 48us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349945.959872:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 330 00000100:00100000:2.0:1783349945.960001:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+20:2402:x1869977642709760:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 34us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349945.960011:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 329 00000100:00080000:0.0:1783349945.961126:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783349945.961216:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349945.961220:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349945.961222:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783349946.244905:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783349946.259466:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1783349946.259493:0:6496:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1783349946.259679:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1783349946.259701:0:6549:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1783349947.268560:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349947.789349:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349947.789381:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659526400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783349947.789478:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349947.789576:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659526400 00000100:00100000:3.0:1783349947.789586:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659526400 00000100:00100000:3.0:1783349947.789659:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783349947.789669:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659526400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783349947.789716:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783349947.789772:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659526400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349947.789779:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783349947.789839:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659526400:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783349948.293817:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783349948.569863:0:14902:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:59:05 (1783349945) 00010000:00010000:3.0:1783349949.316311:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349949.318045:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659526528:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318173:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659527040:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318224:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659527552:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318258:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659528064:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318304:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783349949.318309:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659526656:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318345:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659527168:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318376:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659527680:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318420:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659526784:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318442:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318458:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659527296:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318492:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659527808:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318527:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783349949.318532:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659526912:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318553:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318562:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659527424:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318580:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318595:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659527936:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318612:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.318646:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659526528 00000100:00100000:3.0:1783349949.318653:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659526528 00000100:00100000:3.0:1783349949.318697:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1783349949.318705:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659526528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318757:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea348ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3646:x1869977659526528:12345-0@lo:400:kworker.0 Request processed in 51us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.318771:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1783349949.318819:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659527040 00000100:00100000:3.0:1783349949.318822:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659527040 00000100:00100000:3.0:1783349949.318844:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659526784 00000100:00100000:3.0:1783349949.318847:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659526784 00000100:00100000:3.0:1783349949.318859:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783349949.318864:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659527040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318900:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659527040:12345-0@lo:400:kworker.0 Request processed in 35us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.318906:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783349949.318917:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783349949.318923:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659526784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.318951:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659526784:12345-0@lo:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.318957:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783349949.318973:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659527552 00000100:00100000:3.0:1783349949.318976:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659527552 00000100:00100000:3.0:1783349949.319005:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659528064 00000100:00100000:3.0:1783349949.319008:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659528064 00000100:00100000:3.0:1783349949.319020:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659527424 00000100:00100000:3.0:1783349949.319022:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659527424 00000100:00100000:3.0:1783349949.319033:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659527936 00000100:00100000:3.0:1783349949.319035:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659527936 00000100:00100000:3.0:1783349949.319048:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783349949.319054:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659527552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319083:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659527552:12345-0@lo:400:kworker.0 Request processed in 29us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.319089:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783349949.319106:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783349949.319111:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659528064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319154:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659528064:12345-0@lo:400:kworker.0 Request processed in 24us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.319160:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783349949.319170:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783349949.319176:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659527424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319210:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659527424:12345-0@lo:400:kworker.0 Request processed in 34us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.319216:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783349949.319227:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783349949.319233:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659527936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319259:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659527936:12345-0@lo:400:kworker.0 Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.319265:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783349949.319282:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659526656 00000100:00100000:3.0:1783349949.319286:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659526656 00000100:00100000:3.0:1783349949.319304:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659527168 00000100:00100000:3.0:1783349949.319306:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659527168 00000100:00100000:3.0:1783349949.319317:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659527680 00000100:00100000:3.0:1783349949.319319:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659527680 00000100:00100000:3.0:1783349949.319328:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659527296 00000100:00100000:3.0:1783349949.319330:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659527296 00000100:00100000:3.0:1783349949.319338:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659527808 00000100:00100000:3.0:1783349949.319341:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659527808 00000100:00100000:3.0:1783349949.319351:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659526912 00000100:00100000:3.0:1783349949.319353:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659526912 00000100:00100000:3.0:1783349949.319364:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1783349949.319369:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659526656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319401:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659526656:12345-0@lo:400:kworker.0 Request processed in 32us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.319407:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1783349949.319419:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1783349949.319424:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659527168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319447:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659527168:12345-0@lo:400:kworker.0 Request processed in 24us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.319453:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1783349949.319464:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1783349949.319469:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659527680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319494:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659527680:12345-0@lo:400:kworker.0 Request processed in 25us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.319500:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1783349949.319510:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1783349949.319515:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659527296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319539:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659527296:12345-0@lo:400:kworker.0 Request processed in 24us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.319545:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1783349949.319556:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1783349949.319561:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659527808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319586:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659527808:12345-0@lo:400:kworker.0 Request processed in 25us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.319590:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1783349949.319602:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1783349949.319607:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659526912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319641:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659526912:12345-0@lo:400:kworker.0 Request processed in 33us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.319647:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:3.0:1783349949.319688:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349949.319691:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783349949.319694:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349949.319696:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349949.319726:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659526912:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319738:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659527424:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319746:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659527936:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319755:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659526784:0@lo:400:kworker.0 00010000:00080000:3.0:1783349949.319765:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cf4c700 x1869977659527296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349949.319776:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659527296:0@lo:400:kworker.0 00010000:00080000:3.0:1783349949.319785:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cf4e680 x1869977659527808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349949.319793:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659527808:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319830:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659526656:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319839:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659527168:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319848:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659527680:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319863:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659526528:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319885:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659527040:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319894:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659527552:0@lo:400:kworker.0 00000100:00100000:3.0:1783349949.319902:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659528064:0@lo:400:kworker.0 00000100:00100000:2.0:1783349949.320262:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349949.320274:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659528192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349949.320306:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349949.320333:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659528192 00000100:00100000:2.0:1783349949.320337:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659528192 00000100:00100000:2.0:1783349949.320368:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783349949.320375:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659528192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783349949.320403:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783349949.320441:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659528192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349949.320447:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783349949.320479:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659528192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349949.323189:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349949.323210:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659528320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783349949.323270:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349949.323313:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659528320 00000100:00100000:2.0:1783349949.323319:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659528320 00000100:00100000:2.0:1783349949.323360:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783349949.323368:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659528320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783349949.323399:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783349949.323443:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659528320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349949.323450:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783349949.323492:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659528320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783349949.327105:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659528448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349949.327202:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349949.327307:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659528448 00000100:00100000:3.0:1783349949.327315:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659528448 00000100:00100000:3.0:1783349949.327364:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783349949.327373:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659528448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349949.327394:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783349949.327451:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659528448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349949.327457:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783349949.327588:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659528448:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783349950.345685:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349950.856574:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659528704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783349950.856643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349950.856721:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783349950.856729:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659528576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349950.856753:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349950.856855:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659528704 00000100:00100000:1.0:1783349950.856863:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659528704 00000100:00100000:1.0:1783349950.856900:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659528576 00000100:00100000:1.0:1783349950.856903:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659528576 00000100:00100000:1.0:1783349950.856917:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783349950.856924:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659528704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783349950.856954:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349950.856998:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659528704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349950.857004:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783349950.857020:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783349950.857026:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659528576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349950.857035:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349950.857066:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659528576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349950.857073:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783349950.857115:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659528576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349950.857127:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659528704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783349951.062056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349951.062099:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349951.062123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349951.062199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349951.062216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349951.062235:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349951.062255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349951.062283:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642710784 00000100:00100000:0.0:1783349951.062291:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642710784 00000100:00100000:0.0:1783349951.062366:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642711296 00000100:00100000:0.0:1783349951.062369:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642711296 00000100:00100000:0.0:1783349951.062386:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642710656 00000100:00100000:0.0:1783349951.062388:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642710656 00000100:00100000:0.0:1783349951.062400:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642711168 00000100:00100000:0.0:1783349951.062401:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642711168 00000100:00100000:0.0:1783349951.062417:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 337 00000100:00100000:0.0:1783349951.062426:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642710784:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349951.062496:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642710784:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 71us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349951.062504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 337 00000100:00100000:0.0:1783349951.062521:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 338 00000100:00100000:0.0:1783349951.062541:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642711296:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349951.062569:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2399:x1869977642711296:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 30us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349951.062574:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 338 00000100:00100000:0.0:1783349951.062587:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 339 00000100:00100000:0.0:1783349951.062593:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+19:2399:x1869977642710656:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349951.062615:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+19:2399:x1869977642710656:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349951.062621:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 339 00000100:00100000:0.0:1783349951.062633:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 340 00000100:00100000:0.0:1783349951.062639:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2399:x1869977642711168:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349951.062662:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2399:x1869977642711168:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349951.062667:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 340 00000100:00100000:0.0:1783349951.062686:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642711040 00000100:00100000:0.0:1783349951.062689:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642711040 00000100:00100000:0.0:1783349951.062713:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642710912 00000100:00100000:0.0:1783349951.062716:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642710912 00000100:00100000:0.0:1783349951.062737:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 148 00000100:00100000:0.0:1783349951.062743:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+7:2399:x1869977642711040:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349951.062766:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+7:2399:x1869977642711040:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 24us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349951.062773:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 148 00000100:00100000:0.0:1783349951.062783:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 149 00000100:00100000:0.0:1783349951.062795:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642710912:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783349951.062820:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689af055-7605-419d-81ba-26cff8cb556b+5:2399:x1869977642710912:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349951.062826:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 149 00000100:00080000:0.0:1783349951.062843:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349951.062847:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349951.062849:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783349951.062851:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783349951.063665:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642710528 00000100:00100000:2.0:1783349951.063672:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642710528 00000100:00100000:2.0:1783349951.063713:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 391 00000100:00100000:2.0:1783349951.063721:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642710528:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783349951.063764:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642710528:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 44us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349951.063770:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 391 00010000:00010000:1.0:1783349951.367715:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349952.400203:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349952.901256:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659528832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783349952.901367:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349952.901594:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659528832 00000100:00100000:3.0:1783349952.901605:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659528832 00000100:00100000:3.0:1783349952.901682:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783349952.901693:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659528832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783349952.901738:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783349952.902927:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659528832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1227us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349952.902941:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783349952.903082:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659528832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349953.321354:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349953.321676:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642711552 00000100:00100000:2.0:1783349953.321690:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642711552 00000100:00100000:2.0:1783349953.321780:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:2.0:1783349953.321793:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+19:13150:x1869977642711552:12345-192.168.203.50@tcp:35:umount.0 00000100:00100000:2.0:1783349953.322227:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+20:13150:x1869977642711552:12345-192.168.203.50@tcp:35:umount.0 Request processed in 435us (884us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1783349953.322238:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00080000:0.0:1783349953.322571:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349953.330439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349953.330841:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642711808 00000100:00100000:2.0:1783349953.330855:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642711808 00000100:00100000:2.0:1783349953.330927:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:2.0:1783349953.330939:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+20:13150:x1869977642711808:12345-192.168.203.50@tcp:35:umount.0 00000100:00100000:2.0:1783349953.331526:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+21:13150:x1869977642711808:12345-192.168.203.50@tcp:35:umount.0 Request processed in 585us (1098us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1783349953.331537:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:1.0:1783349953.343107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349953.344563:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642712064 00000100:00100000:2.0:1783349953.344584:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642712064 00000100:00100000:2.0:1783349953.344681:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:2.0:1783349953.344693:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350807850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+21:13150:x1869977642712064:12345-192.168.203.50@tcp:35:umount.0 00000100:00100000:2.0:1783349953.345016:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350807850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+22:13150:x1869977642712064:12345-192.168.203.50@tcp:35:umount.0 Request processed in 324us (1923us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1783349953.345025:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:0.0:1783349953.352983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349953.353078:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642712320 00000100:00100000:2.0:1783349953.353093:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642712320 00000100:00100000:2.0:1783349953.353217:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:2.0:1783349953.353230:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+22:13150:x1869977642712320:12345-192.168.203.50@tcp:35:umount.0 00000100:00100000:2.0:1783349953.353637:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689af055-7605-419d-81ba-26cff8cb556b+23:13150:x1869977642712320:12345-192.168.203.50@tcp:35:umount.0 Request processed in 408us (666us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1783349953.353645:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:1.0:1783349953.359475:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349953.359521:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349953.359556:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349953.359590:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349953.359666:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642712960 00000100:00100000:0.0:1783349953.359679:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642712960 00000100:00100000:0.0:1783349953.359751:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642712832 00000100:00100000:0.0:1783349953.359755:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642712832 00000100:00100000:0.0:1783349953.359772:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642713088 00000100:00100000:0.0:1783349953.359775:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642713088 00000100:00100000:0.0:1783349953.359793:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:0.0:1783349953.359817:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+15:2399:x1869977642712960:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349953.359838:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349953.359863:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cc000/0xd05e6ae1590e203e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd52 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349953.359885:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349953.359953:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+14:2399:x1869977642712960:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 149us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349953.359962:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:0.0:1783349953.359984:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:0.0:1783349953.360010:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+13:2399:x1869977642712832:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349953.360019:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349953.360029:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cca00/0xd05e6ae1590e207d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd91 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349953.360040:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349953.360058:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:2399:x1869977642712832:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 50us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349953.360063:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:0.0:1783349953.360075:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:0.0:1783349953.360081:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:2399:x1869977642713088:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349953.360088:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349953.360096:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd000/0xd05e6ae1590e2340 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece6a expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349953.360104:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349953.360119:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2399:x1869977642713088:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 38us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349953.360126:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:2.0:1783349953.361774:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642712704 00000100:00100000:2.0:1783349953.361790:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642712704 00000100:00100000:2.0:1783349953.361894:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 82 00000100:00100000:2.0:1783349953.361905:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+7:2398:x1869977642712704:12345-192.168.203.50@tcp:9:umount.0 00000020:00000080:2.0:1783349953.361944:0:9981:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2688 00000020:00010000:2.0:1783349953.361953:0:9981:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ea37f56f000: total 0 00000100:00080000:2.0:1783349953.361958:0:9981:0:(import.c:65:import_set_state_nolock()) ffff8ea37f56d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783349953.362027:0:9981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1783349953.362283:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689af055-7605-419d-81ba-26cff8cb556b+5:2398:x1869977642712704:12345-192.168.203.50@tcp:9:umount.0 Request processed in 380us (2822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349953.362291:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 82 00000020:00010000:1.0:1783349953.362417:0:6506:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ea37f56f000: total 0 00010000:00010000:1.0:1783349953.362465:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ea37f56f000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1783349953.362531:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bb092d9/0xd05e6ae1590e311d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded237 expref: 4 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.362571:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a95587b/0xd05e6ae1590e2a47 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded054 expref: 3 pid: 9981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.362588:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ea37f56f000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1783349953.362601:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349953.362620:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349953.362622:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783349953.363767:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349953.367637:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783349953.368008:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642713216 00000100:00100000:3.0:1783349953.368022:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642713216 00000100:00100000:3.0:1783349953.368116:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00100000:3.0:1783349953.368128:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+5:2398:x1869977642713216:12345-192.168.203.50@tcp:9:umount.0 00000100:00080000:0.0:1783349953.368269:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1783349953.368436:0:13811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2af6 00000100:00080000:3.0:1783349953.368464:0:13811:0:(import.c:65:import_set_state_nolock()) ffff8ea37f56f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783349953.368568:0:13811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1783349953.368770:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:689af055-7605-419d-81ba-26cff8cb556b+2:2398:x1869977642713216:12345-192.168.203.50@tcp:9:umount.0 Request processed in 643us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349953.368780:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00100000:3.0:1783349953.379194:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349953.379303:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642714240 00000100:00100000:0.0:1783349953.379317:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642714240 00000100:00100000:0.0:1783349953.379406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 258 00000100:00100000:0.0:1783349953.379418:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+23:2398:x1869977642714240:12345-192.168.203.50@tcp:39:umount.0 00000020:00000080:0.0:1783349953.379464:0:6518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e204c 00000020:00010000:0.0:1783349953.379485:0:6518:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ea24325e800: total 0 00000100:00080000:0.0:1783349953.379509:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ea24325d000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1783349953.383821:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ea24325e800: total 0 00010000:00010000:1.0:1783349953.383912:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ea24325e800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1783349953.383960:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349953.383965:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783349953.383979:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1800/0xd05e6ae1590e26ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decf6d expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384003:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea349e98b00) 00010000:00010000:1.0:1783349953.384005:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349953.384010:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f400/0xd05e6ae1590e2394 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece7f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384030:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:1.0:1783349953.384032:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783349953.384036:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030a00/0xd05e6ae1590e2ffe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded1ea expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384051:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:1.0:1783349953.384053:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349953.384057:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7800/0xd05e6ae1590e30f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded229 expref: 19 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384070:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349953.384072:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783349953.384076:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e2a32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded04d expref: 18 pid: 12147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384117:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:1.0:1783349953.384120:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783349953.384124:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030200/0xd05e6ae1590e2acc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded077 expref: 17 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384175:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349953.384179:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783349953.384182:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea340030c00/0xd05e6ae1590e2928 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded007 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384197:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ea2424c5200) 00010000:00010000:1.0:1783349953.384199:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349953.384203:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea341525000/0xd05e6ae1590e2378 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece78 expref: 15 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384221:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:1.0:1783349953.384222:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783349953.384226:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e30d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded222 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384237:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5d00) 00010000:00010000:1.0:1783349953.384238:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349953.384241:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c7200/0xd05e6ae1590e2ab0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded070 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384253:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ea370dce200) 00010000:00010000:1.0:1783349953.384255:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783349953.384264:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3417c6c00/0xd05e6ae1590e3108 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded230 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384280:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ea24310f800) 00010000:00010000:1.0:1783349953.384282:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783349953.384286:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3429f1000/0xd05e6ae1590e23ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece94 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384301:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ea24310fa00) 00010000:00010000:1.0:1783349953.384304:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349953.384308:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e2a08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded03f expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384321:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ea24311da00) 00010000:00010000:1.0:1783349953.384324:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783349953.384327:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b800/0xd05e6ae1590e2dc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded150 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349953.384340:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ea24325e800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1783349953.384361:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349953.384363:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349953.384365:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783349953.387845:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1783349953.388105:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689af055-7605-419d-81ba-26cff8cb556b+7:2398:x1869977642714240:12345-192.168.203.50@tcp:39:umount.0 Request processed in 8681us (8964us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1783349953.388120:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 258 00010000:00010000:3.0:1783349953.388308:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349953.402509:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349953.403461:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642714368 00000100:00100000:2.0:1783349953.403480:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642714368 00000100:00100000:2.0:1783349953.403583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 259 00000100:00100000:2.0:1783349953.403598:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+5:2398:x1869977642714368:12345-192.168.203.50@tcp:39:umount.0 00000020:00000080:2.0:1783349953.403640:0:6519:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2053 00000100:00080000:2.0:1783349953.403665:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783349953.403703:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783349953.403928:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689af055-7605-419d-81ba-26cff8cb556b+3:2398:x1869977642714368:12345-192.168.203.50@tcp:39:umount.0 Request processed in 334us (1433us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783349953.403936:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 259 00000100:00080000:0.0:1783349953.404628:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783349953.404699:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783349953.413089:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783349953.413740:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783349953.924793:0:13790:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349953.924802:0:13790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349953.924945:0:13790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1783349953.924955:0:13790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783349954.436845:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659529216:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.436939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.437023:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659529728:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.437086:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659530240:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.437167:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1783349954.437176:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659529088:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.437234:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659529600:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.437275:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659530112:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.437317:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659530624:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.437372:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659529216 00000100:00100000:1.0:1783349954.437381:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659529216 00000100:00100000:1.0:1783349954.437433:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659529728 00000100:00100000:1.0:1783349954.437436:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659529728 00000100:00100000:1.0:1783349954.437464:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659530240 00000100:00100000:1.0:1783349954.437467:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659530240 00000100:00100000:1.0:1783349954.437485:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783349954.437494:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659529216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437559:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659529216:12345-0@lo:400:kworker.0 Request processed in 65us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.437567:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783349954.437588:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1783349954.437594:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659529728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437618:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659529728:12345-0@lo:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.437625:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1783349954.437644:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1783349954.437650:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659530240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437678:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659530240:12345-0@lo:400:kworker.0 Request processed in 28us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.437684:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1783349954.437707:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659529088 00000100:00100000:1.0:1783349954.437711:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659529088 00000100:00100000:1.0:1783349954.437740:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1783349954.437747:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659529088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437776:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3647:x1869977659529088:12345-0@lo:400:kworker.0 Request processed in 29us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.437783:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1783349954.437821:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659530112 00000100:00100000:1.0:1783349954.437824:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659530112 00000100:00100000:1.0:1783349954.437848:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659530624 00000100:00100000:1.0:1783349954.437851:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659530624 00000100:00100000:1.0:1783349954.437871:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783349954.437878:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659530112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437909:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659530112:12345-0@lo:400:kworker.0 Request processed in 32us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.437916:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783349954.437927:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783349954.437933:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659530624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.437960:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659530624:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.437966:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783349954.437989:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659528960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349954.438025:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.438044:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659529472:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438064:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.438079:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659529984:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438099:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.438113:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659530496:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438132:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.438194:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783349954.438201:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659529344:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438228:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.438244:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659529856:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438264:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.438281:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659530368:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438301:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349954.438320:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659528960 00000100:00100000:1.0:1783349954.438324:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659528960 00000100:00100000:1.0:1783349954.438353:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783349954.438358:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659528960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349954.438386:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783349954.438423:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659528960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.438429:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783349954.438449:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659529472 00000100:00100000:1.0:1783349954.438453:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659529472 00000100:00100000:1.0:1783349954.438469:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659529856 00000100:00100000:1.0:1783349954.438471:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659529856 00000100:00100000:1.0:1783349954.438494:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659530368 00000100:00100000:1.0:1783349954.438497:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659530368 00000100:00100000:1.0:1783349954.438510:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1783349954.438516:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659529472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438548:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659529472:12345-0@lo:400:kworker.0 Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.438554:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1783349954.438564:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783349954.438570:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659529856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438597:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659529856:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.438602:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783349954.438613:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1783349954.438620:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659530368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438643:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659530368:12345-0@lo:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.438649:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1783349954.438668:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659529984 00000100:00100000:1.0:1783349954.438671:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659529984 00000100:00100000:1.0:1783349954.438690:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659530496 00000100:00100000:1.0:1783349954.438692:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659530496 00000100:00100000:1.0:1783349954.438704:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783349954.438709:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659529984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438739:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659529984:12345-0@lo:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.438744:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783349954.438755:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783349954.438768:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659530496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438797:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659530496:12345-0@lo:400:kworker.0 Request processed in 30us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349954.438803:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00080000:1.0:1783349954.438845:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea244526d80 x1869977659529856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349954.438861:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659529856:0@lo:400:kworker.0 00010000:00080000:1.0:1783349954.438874:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea244526680 x1869977659530368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349954.438882:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659530368:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438899:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659528960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349954.438910:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659529472:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438919:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659529984:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438929:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659530496:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438977:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659529088:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438990:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659530112:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.438998:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659530624:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.439010:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659529216:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.439022:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659529728:0@lo:400:kworker.0 00000100:00100000:1.0:1783349954.439034:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659530240:0@lo:400:kworker.0 00000100:00100000:0.0:1783349954.439204:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659529600 00000100:00100000:0.0:1783349954.439209:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659529600 00000100:00100000:0.0:1783349954.439248:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659529344 00000100:00100000:0.0:1783349954.439252:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659529344 00000100:00100000:0.0:1783349954.439266:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783349954.439273:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659529600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349954.439319:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659529600:12345-0@lo:400:kworker.0 Request processed in 46us (2058us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349954.439325:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783349954.439338:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783349954.439344:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659529344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349954.439375:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659529344:12345-0@lo:400:kworker.0 Request processed in 31us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349954.439380:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1783349954.439399:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783349954.439403:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349954.439406:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349954.439408:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349954.439427:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659529344:0@lo:400:kworker.0 00000100:00100000:0.0:1783349954.439451:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659529600:0@lo:400:kworker.0 00010000:00010000:2.0:1783349954.440921:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349954.441117:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349954.441170:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659530752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783349954.441246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349954.441296:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659530752 00000100:00100000:3.0:1783349954.441304:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659530752 00000100:00100000:3.0:1783349954.441359:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783349954.441369:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659530752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783349954.441396:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783349954.441444:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659530752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349954.441452:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783349954.441504:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659530752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783349954.441635:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349954.441647:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659530880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783349954.441682:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349954.441712:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659530880 00000100:00100000:0.0:1783349954.441716:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659530880 00000100:00100000:0.0:1783349954.441743:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783349954.441749:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659530880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783349954.441778:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783349954.441816:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659530880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349954.441823:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783349954.441849:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659530880:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783349955.463236:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349955.972753:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349955.972783:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659531008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349955.972860:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349955.973030:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659531008 00000100:00100000:1.0:1783349955.973040:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659531008 00000100:00100000:1.0:1783349955.973094:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783349955.973103:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659531008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349955.973166:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783349955.973220:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659531008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349955.973227:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783349955.973274:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659531008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349955.978747:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349955.978847:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659531136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349955.979083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349955.982197:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659531136 00000100:00100000:3.0:1783349955.982212:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659531136 00000100:00100000:3.0:1783349955.982287:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783349955.982307:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659531136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783349955.982335:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783349955.982453:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659531136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349955.982461:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783349955.982762:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659531136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783349956.099601:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349956.099641:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349956.099678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783349956.099710:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642714496 00000100:00100000:2.0:1783349956.099730:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642714496 00000100:00100000:0.0:1783349956.099763:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642714752 00000100:00100000:0.0:1783349956.099769:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642714752 00000100:00100000:2.0:1783349956.099797:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642714624 00000100:00100000:2.0:1783349956.099802:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642714624 00000100:00100000:0.0:1783349956.099820:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:0.0:1783349956.099835:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+12:2401:x1869977642714496:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349956.099851:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349956.099923:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8e800/0xd05e6ae1590e214f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decda6 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349956.099941:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349956.099988:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:2401:x1869977642714496:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 159us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349956.101459:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:2.0:1783349956.101479:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+11:2401:x1869977642714752:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349956.101503:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349956.101524:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8fe00/0xd05e6ae1590e231d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5dece63 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349956.101539:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349956.101579:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+10:2401:x1869977642714752:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 109us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349956.101587:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:2.0:1783349956.101608:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:2.0:1783349956.101615:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea35094b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+9:2401:x1869977642714624:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349956.101624:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349956.101633:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215ee00/0xd05e6ae1590e2156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decdd7 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349956.101663:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349956.101682:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea35094b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+8:2401:x1869977642714624:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 68us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349956.101689:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:2.0:1783349956.111283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349956.111386:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642715008 00000100:00100000:1.0:1783349956.111474:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642715008 00000100:00100000:1.0:1783349956.111581:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 260 00000100:00100000:1.0:1783349956.111592:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+6:2398:x1869977642715008:12345-192.168.203.50@tcp:39:umount.0 00000020:00000080:1.0:1783349956.111632:0:6517:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e216b 00000020:00010000:1.0:1783349956.111640:0:6517:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ea2434dd000: total 0 00000100:00080000:1.0:1783349956.111645:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8ea2434db000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783349956.111669:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1783349956.112913:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2398:x1869977642715008:12345-192.168.203.50@tcp:39:umount.0 Request processed in 1315us (1631us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1783349956.112924:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 260 00000020:00010000:1.0:1783349956.112981:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ea2434dd000: total 0 00010000:00010000:1.0:1783349956.112985:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349956.113043:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ea2434dd000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783349956.113074:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c5d00) 00010000:00010000:1.0:1783349956.113078:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349956.113085:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8cc00/0xd05e6ae1590e312b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded23e expref: 4 pid: 8582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349956.113106:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ea2434dd000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783349956.113116:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349956.113118:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349956.113119:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783349956.113499:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349956.118480:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:2.0:1783349956.120448:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783349956.120560:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642715136 00000100:00100000:1.0:1783349956.120570:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642715136 00000100:00100000:1.0:1783349956.120639:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 261 00000100:00100000:1.0:1783349956.120650:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+5:2398:x1869977642715136:12345-192.168.203.50@tcp:39:umount.0 00000020:00000080:1.0:1783349956.120688:0:6519:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2164 00000100:00080000:1.0:1783349956.120697:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8ea243523800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783349956.120738:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1783349956.120875:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349956.120889:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1+3:2398:x1869977642715136:12345-192.168.203.50@tcp:39:umount.0 Request processed in 240us (446us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783349956.120897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 261 00000100:00080000:2.0:1783349956.121078:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783349956.166727:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783349956.168470:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642715392 00000100:00100000:0.0:1783349956.168483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642715392 00000100:00100000:0.0:1783349956.168568:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 393 00000100:00100000:0.0:1783349956.168577:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+7:2398:x1869977642715392:12345-192.168.203.50@tcp:251:umount.0 00000020:00000080:0.0:1783349956.168623:0:6512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2029 00000020:00010000:0.0:1783349956.168630:0:6512:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ea24321c800: total 0 00000100:00080000:0.0:1783349956.168634:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8ea24321a000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783349956.168714:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9adf8385-2fc7-4e71-b2a6-262a64a4b4cf+3:2398:x1869977642715392:12345-192.168.203.50@tcp:251:umount.0 Request processed in 139us (1996us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349956.168721:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 393 00000020:00010000:2.0:1783349956.169467:0:6506:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ea24321c800: total 0 00010000:00010000:2.0:1783349956.169517:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ea24321c800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783349956.169551:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e2084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5decd98 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349956.169566:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ea24321c800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1783349956.169576:0:6506:0:(genops.c:906:class_export_put()) final put ffff8ea24321c800/9adf8385-2fc7-4e71-b2a6-262a64a4b4cf 00010000:00010000:2.0:1783349956.169590:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349956.169593:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349956.169595:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783349956.169899:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24321c800/9adf8385-2fc7-4e71-b2a6-262a64a4b4cf for MGS 00000020:00000080:0.0:1783349956.169939:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea24321a000 for MGS 00010000:00010000:1.0:1783349956.484375:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349957.509017:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349958.021465:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659531264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783349958.021555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349958.021644:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659531264 00000100:00100000:1.0:1783349958.021652:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659531264 00000100:00100000:1.0:1783349958.021700:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783349958.021708:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659531264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783349958.021741:0:7578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783349958.041548:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659531264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 19830us (19983us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349958.041574:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783349958.044990:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659531264:0@lo:41:osp-pre-0-1.0 00000020:01000004:3.0:1783349958.241812:0:15098:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783349958.265344:0:15098:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783349958.265397:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.265412:0:15098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.265420:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.265427:0:15098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.265457:0:15098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783349958.265463:0:15098:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783349958.265483:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783349958.265487:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783349958.265492:0:15098:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783349958.265515:0:15098:0:(import.c:65:import_set_state_nolock()) ffff8ea36ce3d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783349958.265546:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659531392:0@lo:39:umount.0 00000100:00100000:3.0:1783349958.265607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349958.265713:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349958.265720:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.265727:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fa00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349958.265731:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.265738:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349958.265745:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349958.265750:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783349958.265761:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783349958.265763:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783349958.265788:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.265795:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349958.265821:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.265829:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e2117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e211e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.265840:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349958.265842:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349958.265843:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349958.265858:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659531392 00000100:00100000:0.0:1783349958.265864:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659531392 00000100:00100000:0.0:1783349958.265904:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783349958.265912:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869977659531392:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783349958.265936:0:6518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1c40 00000100:00080000:0.0:1783349958.265944:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8ea36ce3b000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783349958.265998:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1869977659531392:12345-0@lo:39:umount.0 Request processed in 86us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349958.266005:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1783349958.266015:0:6518:0:(genops.c:906:class_export_put()) final put ffff8ea36ce39800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1783349958.266033:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349958.266043:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659531520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349958.266068:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349958.266127:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783349958.266169:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36ce3d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783349958.266184:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659531392:0@lo:39:umount.0 00000020:00000080:0.0:1783349958.266206:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36ce39800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783349958.266242:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36ce3b000 for lustre-MDT0000 00000100:00100000:0.0:1783349958.266256:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659531520 00000100:00100000:0.0:1783349958.266259:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659531520 00000100:00100000:0.0:1783349958.266287:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783349958.266293:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659531520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349958.266304:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349958.266316:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582ccc00/0xd05e6ae1590e211e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e2117 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.266327:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349958.266353:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:3649:x1869977659531520:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349958.266359:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783349958.266387:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659531520:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783349958.266959:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783349958.266963:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783349958.266975:0:15098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783349958.269267:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.269284:0:15098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.269291:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.269297:0:15098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.269367:0:15098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349958.269374:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.269381:0:15098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.269388:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.269395:0:15098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277254:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783349958.277268:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277281:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3429f0000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349958.277285:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277296:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349958.277304:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349958.277325:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783349958.277328:0:7458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1783349958.277366:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277373:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349958.277403:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277410:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3429f0000/0xd05e6ae1590e2125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e212c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277426:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349958.277430:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277435:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f000 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349958.277438:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277445:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349958.277452:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349958.277457:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1783349958.277459:0:7458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1783349958.277470:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277482:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349958.277497:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277504:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349958.277506:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349958.277508:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349958.277530:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659531648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349958.277588:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349958.277648:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659531776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349958.277671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349958.277701:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659531648 00000100:00100000:0.0:1783349958.277709:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659531648 00000100:00100000:0.0:1783349958.277745:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659531776 00000100:00100000:0.0:1783349958.277747:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659531776 00000100:00100000:0.0:1783349958.277765:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783349958.277772:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+24:3649:x1869977659531648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349958.277784:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349958.277799:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e212c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e2125 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.277810:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349958.278948:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+23:3649:x1869977659531648:12345-0@lo:103:ldlm_bl.0 Request processed in 1172us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349958.278959:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783349958.278986:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783349958.279000:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+22:3646:x1869977659531776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349958.279023:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349958.279039:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd200/0xd05e6ae1590e1fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e1fe3 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.279051:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349958.279086:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:3646:x1869977659531776:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1414us total) trans 0 rc 0/0 00010000:00010000:3.0:1783349958.280223:0:15098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783349958.280234:0:15098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f000/0xd05e6ae1590e1fe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1fea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349958.280250:0:15098:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783349958.280269:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.280277:0:15098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.280284:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.280290:0:15098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.280304:0:15098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349958.280309:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.280315:0:15098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.280319:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.280324:0:15098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349958.280334:0:15098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783349958.280336:0:15098:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1783349958.280339:0:15098:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1783349958.280376:0:15098:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783349958.280380:0:15098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1783349958.280385:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783349958.280395:0:15098:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1783349958.280401:0:15098:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ea375e03800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783349958.280407:0:15098:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ea36d8ff000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783349958.280412:0:15098:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ea359384000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783349958.280416:0:15098:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ea36cf5f000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1783349958.280424:0:15098:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8ea2434dd000 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 192.168.203.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783349958.280428:0:15098:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8ea24325e800 689af055-7605-419d-81ba-26cff8cb556b 192.168.203.50@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:3.0:1783349958.280433:0:15098:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8ea349f8cd40) has exports, disconnecting them 00000020:00080000:3.0:1783349958.280437:0:15098:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ea375e03800), last request at 1783349954 00000020:00000080:3.0:1783349958.280443:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1f57 00000100:00080000:3.0:1783349958.280459:0:15098:0:(import.c:65:import_set_state_nolock()) ffff8ea375e04000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783349958.280508:0:15098:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea375e03800): rc 0 00000020:00000080:3.0:1783349958.280511:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea375e03800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783349958.280521:0:15098:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ea36d8ff000), last request at 1783349954 00000020:00000080:3.0:1783349958.280524:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1e2a 00000100:00080000:3.0:1783349958.280528:0:15098:0:(import.c:65:import_set_state_nolock()) ffff8ea36d8fd000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783349958.280534:0:15098:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea36d8ff000): rc 0 00000020:00000080:3.0:1783349958.280536:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea36d8ff000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783349958.280540:0:15098:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ea359384000), last request at 1783349742 00000020:00000080:3.0:1783349958.280542:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1d27 00000100:00080000:3.0:1783349958.280545:0:15098:0:(import.c:65:import_set_state_nolock()) ffff8ea359384800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783349958.280549:0:15098:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea359384000): rc 0 00000020:00000080:3.0:1783349958.280551:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea359384000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783349958.280555:0:15098:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ea36cf5f000), last request at 1783349742 00000020:00000080:3.0:1783349958.280557:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1ce8 00000100:00080000:3.0:1783349958.280560:0:15098:0:(import.c:65:import_set_state_nolock()) ffff8ea36cf5d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783349958.280572:0:15098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:3.0:1783349958.280642:0:15098:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea36cf5f000): rc 0 00000004:00000080:3.0:1783349958.280648:0:15098:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9d9843337ae0 00000100:00080000:3.0:1783349958.280665:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783349958.280669:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1783349958.281207:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1783349958.281254:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783349958.281261:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281269:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349958.281273:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281280:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349958.281286:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349958.281292:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783349958.281294:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783349958.281296:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783349958.281327:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281334:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349958.281352:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281366:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f600/0xd05e6ae1590e2347 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e234e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281378:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349958.281382:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281387:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349958.281390:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281396:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349958.281402:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349958.281407:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783349958.281409:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783349958.281411:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1783349958.281424:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281430:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349958.281441:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281448:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e1b9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1ba6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281469:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349958.281471:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349958.281472:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349958.281478:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783349958.281485:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e03800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783349958.281521:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d8ff000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783349958.281539:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea359384000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783349958.281562:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea375e04000 for lustre-MDT0000 00000020:00000080:0.0:1783349958.281568:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36d8fd000 for lustre-MDT0000 00000020:00000080:0.0:1783349958.281571:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea359384800 for lustre-MDT0000 00000100:00100000:0.0:1783349958.281590:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659531904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349958.281648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349958.281690:0:13183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659531904 00000100:00100000:0.0:1783349958.281698:0:13183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659531904 00000100:00100000:0.0:1783349958.281734:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783349958.281741:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+21:3647:x1869977659531904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349958.281753:0:13183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349958.281765:0:13183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e234e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e2347 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281775:0:13183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349958.281805:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:3647:x1869977659531904:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349958.281811:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783349958.281838:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3647:1869977659531904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349958.281856:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659532032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349958.281883:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349958.281907:0:7459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659532032 00000100:00100000:0.0:1783349958.281910:0:7459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659532032 00000100:00100000:0.0:1783349958.281930:0:7459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783349958.281936:0:7459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243badc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+20:3648:x1869977659532032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349958.281943:0:7459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349958.281951:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215e800/0xd05e6ae1590e1ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e1b9f expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349958.281960:0:7459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349958.281984:0:7459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243badc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3648:x1869977659532032:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349958.281990:0:7459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783349958.282014:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3648:1869977659532032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349958.282036:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659531776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349958.282056:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659531648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349958.282069:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783349958.282517:0:15098:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783349958.282535:0:15098:0:(import.c:65:import_set_state_nolock()) ffff8ea37b61a800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783349958.288221:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659532160:0@lo:39:umount.0 00000100:00100000:0.0:1783349958.288290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349958.288340:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659532160 00000100:00100000:0.0:1783349958.288348:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659532160 00000100:00100000:0.0:1783349958.288385:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783349958.288392:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869977659532160:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783349958.288422:0:6522:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1d82 00000100:00080000:0.0:1783349958.288430:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8ea36da90000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783349958.288449:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1783349958.288574:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3645:x1869977659532160:12345-0@lo:39:umount.0 Request processed in 181us (283us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783349958.288581:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00010000:00010000:0.0:1783349958.288604:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783349958.288626:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea37b61a800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783349958.288632:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659532160:0@lo:39:umount.0 00000100:00080000:3.0:1783349958.290078:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783349958.290084:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1783349958.290104:0:15098:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783349958.290195:0:15098:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783349958.290219:0:15098:0:(import.c:65:import_set_state_nolock()) ffff8ea24271c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783349958.290233:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783349958.290236:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1783349958.290245:0:15098:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783349958.290303:0:15098:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783349958.290312:0:15098:0:(import.c:65:import_set_state_nolock()) ffff8ea24321d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783349958.290336:0:15098:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8ea349f8cd40) has no exports 00000100:00100000:0.0:1783349958.290648:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659532288:0@lo:9:umount.0 00000100:00100000:0.0:1783349958.290704:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349958.290737:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659532416:0@lo:9:umount.0 00000100:00100000:0.0:1783349958.290758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349958.290827:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659532288 00000100:00100000:0.0:1783349958.290833:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659532288 00000100:00100000:0.0:1783349958.290880:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659532416 00000100:00100000:0.0:1783349958.290884:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659532416 00000100:00100000:0.0:1783349958.290906:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783349958.290914:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869977659532288:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783349958.290937:0:8433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1ed9 00000100:00080000:0.0:1783349958.290944:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8ea24271f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783349958.290980:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1783349958.291561:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783349958.291572:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1869977659532416:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783349958.291589:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2014 00000100:00080000:1.0:1783349958.291595:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8ea24325f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783349958.291629:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1783349958.291714:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3645:x1869977659532416:12345-0@lo:9:umount.0 Request processed in 145us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349958.291720:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1783349958.291741:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349958.291745:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349958.292796:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3645:x1869977659532288:12345-0@lo:9:umount.0 Request processed in 177us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349958.292805:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:0.0:1783349958.292833:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783349958.294786:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783349958.294813:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783349958.294816:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783349958.294823:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659532288:0@lo:9:umount.0 00000100:00080000:1.0:1783349958.294839:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24321d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783349958.294849:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783349958.294851:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783349958.294854:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659532416:0@lo:9:umount.0 00010000:00010000:1.0:1783349958.294890:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783349958.310617:0:15098:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8ea349f8cd40) has no exports 00000020:00000080:3.0:1783349958.380920:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1bfa 00000020:00000080:3.0:1783349958.380935:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea36cd3c000/lustre-QMT0000_UUID 00000020:01000000:3.0:1783349958.380953:0:15098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783349958.381172:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783349958.381182:0:15098:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783349958.381186:0:15098:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8ea37b5419c0) has no exports 00000020:00000080:2.0:1783349958.381639:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1bf3 00000020:00000080:2.0:1783349958.381645:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea36ccc3000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783349958.381690:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349958.381698:0:15098:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783349958.381755:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36cd3c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783349958.381761:0:37:0:(genops.c:906:class_export_put()) final put ffff8ea36ccc7800/lustre-QMT0000_UUID 00000020:00000080:0.0:1783349958.381763:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36ccc7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783349958.381770:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1783349958.381898:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36ccc3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1783349958.533303:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783349959.050245:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783349959.050254:0:9511:0:(genops.c:906:class_export_put()) final put ffff8ea24325e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783349959.050346:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:1.0:1783349959.050349:0:9511:0:(genops.c:906:class_export_put()) final put ffff8ea37f56f000/689af055-7605-419d-81ba-26cff8cb556b 00000001:00100000:0.0:1783349959.052299:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783349959.052321:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1783349959.053038:0:7448:0:(genops.c:906:class_export_put()) final put ffff8ea36d91c800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783349959.056914:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783349959.056928:0:8426:0:(genops.c:906:class_export_put()) final put ffff8ea24271e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783349959.057754:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783349959.057820:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea24325f800 for lustre-OST0001 00000020:00000080:3.0:1783349959.059904:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f56f000/689af055-7605-419d-81ba-26cff8cb556b for lustre-OST0001 00000020:00000080:3.0:1783349959.059958:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea37f56d000 for lustre-OST0001 00000001:00100000:0.0:1783349959.061222:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000001:00080000:0.0:1783349959.061249:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1783349959.061258:0:7448:0:(genops.c:906:class_export_put()) final put ffff8ea243524800/2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000001:00100000:0.0:1783349959.061269:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000001:00080000:0.0:1783349959.061277:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1783349959.061279:0:7448:0:(genops.c:906:class_export_put()) final put ffff8ea24325c800/689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:1.0:1783349959.061860:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d91c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1783349959.062025:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea243524800/2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 for lustre-MDT0001 00000020:00000080:1.0:1783349959.062055:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325c800/689af055-7605-419d-81ba-26cff8cb556b for lustre-MDT0001 00000020:00000080:1.0:1783349959.062119:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36da90000 for lustre-MDT0001 00000020:00000080:1.0:1783349959.062125:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea243523800 for lustre-MDT0001 00000020:00000080:1.0:1783349959.062128:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea243259000 for lustre-MDT0001 00000001:00100000:0.0:1783349959.063035:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783349959.063046:0:6496:0:(genops.c:906:class_export_put()) final put ffff8ea36cf5f000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1783349959.063079:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000001:00080000:0.0:1783349959.063090:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1783349959.063094:0:6496:0:(genops.c:906:class_export_put()) final put ffff8ea2434dd000/2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 00000001:00100000:0.0:1783349959.063236:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000001:00080000:0.0:1783349959.063250:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1783349959.063262:0:6496:0:(genops.c:906:class_export_put()) final put ffff8ea24325e800/689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:3.0:1783349959.063428:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36cf5f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783349959.063505:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2434dd000/2896a0fa-c3a4-4e9a-98a5-0b90da94a3b1 for lustre-MDT0000 00000020:00000080:3.0:1783349959.063774:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24325e800/689af055-7605-419d-81ba-26cff8cb556b for lustre-MDT0000 00000020:00000080:3.0:1783349959.063806:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36cf5d000 for lustre-MDT0000 00000020:00000080:3.0:1783349959.063812:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea2434db000 for lustre-MDT0000 00000020:00000080:3.0:1783349959.063818:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea24325d000 for lustre-MDT0000 00000020:00000080:1.0:1783349959.069098:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24271e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:2.0:1783349959.069705:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:2.0:1783349959.069738:0:8426:0:(genops.c:906:class_export_put()) final put ffff8ea37f56a000/689af055-7605-419d-81ba-26cff8cb556b 00000020:00000080:1.0:1783349959.078992:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea24271f800 for lustre-OST0000 00000020:00000080:1.0:1783349959.079020:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f56a000/689af055-7605-419d-81ba-26cff8cb556b for lustre-OST0000 00000020:00000080:1.0:1783349959.079085:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea37f56f800 for lustre-OST0000 00000100:00100000:1.0:1783349959.556440:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349959.556476:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659532544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349959.556591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349959.556605:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659532672:0@lo:400:kworker.0 00000100:00100000:2.0:1783349959.556664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349959.556670:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659532544 00000100:00100000:1.0:1783349959.556678:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659532928:0@lo:400:kworker.0 00000100:00100000:3.0:1783349959.556680:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659532544 00000100:00100000:2.0:1783349959.556704:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659533184:0@lo:400:kworker.0 00000100:00100000:1.0:1783349959.556719:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349959.556744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349959.556748:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659533440:0@lo:400:kworker.0 00000100:00100000:3.0:1783349959.556755:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783349959.556767:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659532544:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783349959.556774:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783349959.556781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349959.556784:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659532800:0@lo:400:kworker.0 00002000:00000024:3.0:1783349959.556809:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783349959.556810:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783349959.556822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349959.556822:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659533056:0@lo:400:kworker.0 00000100:00100000:2.0:1783349959.556848:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659533312:0@lo:400:kworker.0 00000100:00100000:3.0:1783349959.556872:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659532544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349959.556881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349959.556889:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783349959.556890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349959.556908:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659533568:0@lo:400:kworker.0 00000100:00100000:2.0:1783349959.556931:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659533312 00000100:00100000:2.0:1783349959.556936:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659533312 00000100:00100000:1.0:1783349959.556937:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349959.556982:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783349959.556987:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659532544:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783349959.556990:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349959.556994:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659533312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349959.557038:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659533312:12345-0@lo:400:kworker.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349959.557045:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783349959.557077:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659533312:0@lo:400:kworker.0 00000100:00080000:2.0:1783349959.557114:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349959.557119:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349959.557159:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659532672 00000100:00100000:2.0:1783349959.557164:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659532672 00000100:00100000:2.0:1783349959.557202:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1783349959.557208:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3646:x1869977659532672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349959.557241:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3582ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6edd2b87-ce4c-4997-b296-e0eb4341b4ab+19:3646:x1869977659532672:12345-0@lo:400:kworker.0 Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349959.557266:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1783349959.557300:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659532672:0@lo:400:kworker.0 00000100:00100000:2.0:1783349959.557341:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659532800 00000100:00100000:2.0:1783349959.557345:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659532800 00000100:00100000:2.0:1783349959.557367:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783349959.557372:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1869977659532800:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783349959.557379:0:7578:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783349959.557410:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1869977659532800:12345-0@lo:400:kworker.0 Request processed in 37us (590us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783349959.557416:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1783349959.562893:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659532928 00000100:00100000:3.0:1783349959.562914:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659532928 00000100:00100000:3.0:1783349959.562970:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659533184 00000100:00100000:3.0:1783349959.562974:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659533184 00000100:00100000:3.0:1783349959.563040:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659533440 00000100:00100000:3.0:1783349959.563043:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659533440 00000100:00100000:3.0:1783349959.563053:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659533056 00000100:00100000:3.0:1783349959.563056:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659533056 00000100:00100000:3.0:1783349959.563064:0:12147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659533568 00000100:00100000:3.0:1783349959.563066:0:12147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659533568 00000100:00100000:3.0:1783349959.563092:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1783349959.563113:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659533184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349959.563264:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659533184:12345-0@lo:400:kworker.0 Request processed in 161us (6518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349959.563273:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1783349959.563292:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1783349959.563299:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659533568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349959.563369:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869977659533568:12345-0@lo:400:kworker.0 Request processed in 70us (6432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349959.563376:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1783349959.563388:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783349959.563392:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869977659532928:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783349959.563398:0:12147:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783349959.563427:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869977659532928:12345-0@lo:400:kworker.0 Request processed in 33us (6709us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783349959.563433:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783349959.563445:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783349959.563448:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869977659533440:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783349959.563453:0:12147:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783349959.563476:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869977659533440:12345-0@lo:400:kworker.0 Request processed in 26us (6695us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783349959.563482:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783349959.563493:0:12147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783349959.563496:0:12147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869977659533056:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783349959.563500:0:12147:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783349959.563523:0:12147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869977659533056:12345-0@lo:400:kworker.0 Request processed in 25us (6646us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783349959.563529:0:12147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1783349959.563558:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783349959.563637:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783349959.563644:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783349959.563649:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783349959.575285:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783349959.575298:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ea36d8fb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783349959.575304:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783349959.575311:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ea36d8fb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783349959.575316:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 199 00000100:00080000:0.0:1783349959.575327:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ea36d8fb000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349959.575379:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243badf80 x1869977659533696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349959.577747:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659533056:0@lo:400:kworker.0 00010000:00080000:0.0:1783349959.577808:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cf4ce00 x1869977659533568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349959.577823:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659533568:0@lo:400:kworker.0 00000100:00080000:0.0:1783349959.577840:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783349959.577846:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ea375e0f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783349959.577850:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783349959.577857:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ea375e0f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783349959.577861:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 183 00000100:00080000:0.0:1783349959.577872:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ea375e0f800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349959.577918:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243bac700 x1869977659533824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349959.577932:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659532928:0@lo:400:kworker.0 00000100:00080000:0.0:1783349959.577946:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783349959.577949:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ea243524000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783349959.577952:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783349959.577955:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ea243524000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783349959.577958:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 218 00000100:00080000:0.0:1783349959.577962:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ea243524000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349959.577977:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243bad880 x1869977659533952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349959.578010:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659533440:0@lo:400:kworker.0 00000100:00100000:0.0:1783349959.578123:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659533696:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1783349959.578221:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349959.578259:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659533824:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1783349959.578279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349959.578293:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659533952:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1783349959.578309:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349959.578347:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659533696 00000100:00100000:0.0:1783349959.578354:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659533696 00000100:00100000:0.0:1783349959.578383:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659533824 00000100:00100000:0.0:1783349959.578386:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659533824 00000100:00100000:0.0:1783349959.578393:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659533952 00000100:00100000:0.0:1783349959.578395:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659533952 00000100:00100000:0.0:1783349959.578408:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783349959.578416:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659533696:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1783349959.578435:0:6518:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783349959.579042:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783349959.579052:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659533824:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1783349959.579065:0:6519:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783349959.579175:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659533824:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 122us (894us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783349959.579315:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1783349959.579370:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea375e0f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783349959.579376:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783349959.579380:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659533824:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783349959.579409:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783349959.579414:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659533952:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1783349959.579422:0:6519:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783349959.579456:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659533952:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 41us (1145us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783349959.579462:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1783349959.579484:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243524000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783349959.579489:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783349959.579491:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659533952:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1783349959.580785:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783349959.581471:0:3646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 183 00000100:00080000:3.0:1783349959.581484:0:3646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ea375e3a800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783349959.581523:0:3646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36cf4e680 x1869977659534080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783349959.581555:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659532800:0@lo:400:kworker.0 00000100:00100000:3.0:1783349959.581579:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659534080:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783349959.581639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783349959.581709:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cf4d880 x1869977659533184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349959.581720:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659533184:0@lo:400:kworker.0 00000100:00100000:1.0:1783349959.583933:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659534080 00000100:00100000:1.0:1783349959.583951:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659534080 00000100:00100000:1.0:1783349959.584012:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783349959.584023:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659534080:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1783349959.584048:0:6523:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783349959.584218:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659534080:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 195us (2577us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783349959.584228:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:3.0:1783349959.584302:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783349959.584330:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783349959.584336:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659534080:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783349959.614051:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659533696:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 35624us (35820us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783349959.614068:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1783349959.615587:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d8fb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783349959.615598:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783349959.615603:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659533696:0@lo:38:ptlrpcd_00_02.0 00000020:01000000:2.0:1783349960.388380:0:15098:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea375fd14e0 - data ffff8ea371291288/ffff8ea24386bc00 00000020:01000000:2.0:1783349960.388594:0:15098:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea36cd9fc60 - data ffff8ea37115e798/ffff8ea36ccfc800 00000001:00000004:2.0:1783349960.397561:0:15098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:1.0:1783349960.477514:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783349960.477527:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1783349960.477547:0:15098:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ea241da4e00 x1869977659532160/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783349968 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349960.478712:0:15098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783349960.499338:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783349960.499351:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1783349960.499687:0:15098:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783349960.499692:0:15098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783349960.500543:0:8584:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783349960.500550:0:8584:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1783349960.500565:0:8584:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1783349960.502001:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783349960.502011:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1783349960.502213:0:15098:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783349960.502217:0:15098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783349960.511728:0:9984:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783349960.511742:0:9984:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1783349960.511767:0:9984:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783349960.515817:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1bc2 00000020:00000080:1.0:1783349960.515836:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea357edf800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783349960.517608:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea357edf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783349960.522073:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1bd7 00000020:00000080:3.0:1783349960.522105:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea370da1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783349960.522272:0:15098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783349960.522278:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783349960.522289:0:15098:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783349960.522294:0:15098:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8ea370dfcd40) has no exports 00000020:00000080:1.0:1783349960.522447:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea370da1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1783349960.522645:0:15098:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783349960.522657:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e200d 00000020:00000080:3.0:1783349960.522662:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea2434d9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783349960.522709:0:15098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783349960.522713:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783349960.522724:0:15098:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783349960.522727:0:15098:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff8ea241dc8000) has no exports 00000020:00000080:3.0:1783349960.522736:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e2006 00000020:00000080:3.0:1783349960.522741:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea375e3b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783349960.526697:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2434d9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1783349960.534893:0:15098:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783349960.534906:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783349960.534913:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1783349960.534922:0:15098:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783349960.534925:0:15098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783349960.540171:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e3b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783349960.540543:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea24321d800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783349960.540631:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783349960.540653:0:15098:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783349960.540659:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea375e0d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783349960.540663:0:15098:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e0d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783349960.540673:0:15098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783349960.540789:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1ecb 00000020:00000080:3.0:1783349960.540796:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea37f493800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783349960.540844:0:15098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783349960.540850:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783349960.540856:0:15098:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783349960.540861:0:15098:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff8ea24244b380) has no exports 00000020:00000080:3.0:1783349960.540870:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1ec4 00000020:00000080:3.0:1783349960.540874:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea24271a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783349960.547256:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f493800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1783349960.549719:0:15098:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783349960.549746:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783349960.549752:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1783349960.549761:0:15098:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783349960.549764:0:15098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783349960.552250:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24271a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783349960.553237:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea24271c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783349960.553918:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783349960.553997:0:15098:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783349960.554004:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea24271c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783349960.554009:0:15098:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24271c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783349960.554028:0:15098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783349960.554187:0:15098:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783349960.554197:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1d7b 00000020:00000080:3.0:1783349960.554206:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea375e0c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783349960.554223:0:15098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783349960.554227:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783349960.554234:0:15098:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783349960.554238:0:15098:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8ea36d140000) has no exports 00000020:00000080:3.0:1783349960.554246:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1d74 00000020:00000080:3.0:1783349960.554250:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea36ccdf000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783349960.554467:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e0c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783349960.558795:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36ccdf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783349960.643230:0:15098:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783349960.643244:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783349960.643250:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1783349960.643262:0:15098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783349960.643330:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea37b61a800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783349960.643341:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349960.643360:0:15098:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783349960.643367:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea375e06000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783349960.643388:0:15098:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e06000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1783349960.643405:0:15098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783349960.643552:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349960.643558:0:15098:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783349960.643561:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea357eda000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783349960.643563:0:15098:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea357eda000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783349960.643569:0:15098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783349960.643626:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1bde 00000020:00000080:0.0:1783349960.643635:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea370da3800/lustre-MDD0000_UUID 00000020:01000000:0.0:1783349960.643651:0:15098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783349960.643655:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783349960.643660:0:15098:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783349960.643665:0:15098:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8ea349f899c0) has no exports 00000020:00000080:0.0:1783349960.643694:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349960.643698:0:15098:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783349960.643701:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1be5 00000020:00000080:0.0:1783349960.643706:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea370da6000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783349960.643716:0:15098:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea3461c1000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783349960.643720:0:15098:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea3461c1000 3 00000020:01000004:0.0:1783349960.643724:0:15098:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ea3461c1000 from lustre-MDT0000 00000020:00000080:0.0:1783349960.643748:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349960.643752:0:15098:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783349960.643755:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea370da0000/lustre-MDT0000_UUID 00000020:00000080:0.0:1783349960.643757:0:15098:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea370da0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783349960.643764:0:15098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783349960.643796:0:15098:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783349960.643800:0:15098:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783349960.643803:0:15098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783349960.643806:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783349960.643809:0:15098:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783349960.643817:0:15098:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8ea358202800 6edd2b87-ce4c-4997-b296-e0eb4341b4ab 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783349960.643823:0:15098:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8ea349e319c0) has exports, disconnecting them 00000020:00080000:0.0:1783349960.643835:0:15098:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ea358202800), last request at 1783349726 00000020:00000080:0.0:1783349960.643853:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1b7c 00000020:00010000:0.0:1783349960.643858:0:15098:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ea358202800: total 2 00000100:00080000:0.0:1783349960.643862:0:15098:0:(import.c:65:import_set_state_nolock()) ffff8ea358200000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783349960.643876:0:15098:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea358202800): rc 0 00000020:00080000:0.0:1783349960.643881:0:15098:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8ea349e319c0) has no exports 00000100:00100000:0.0:1783349960.643951:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ea350852200:6510] 0 exiting: rc = 1 00000020:00010000:1.0:1783349960.644057:0:7458:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ea358202800: total 2 00000100:00100000:0.0:1783349960.644070:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ea344c3ec00:6512] 2 exiting: rc = 0 00010000:00010000:1.0:1783349960.644127:0:7458:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ea358202800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783349960.644196:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215fc00/0xd05e6ae1590e2148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e2141 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644217:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cd400/0xd05e6ae1590e20d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e20d1 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644245:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f0200/0xd05e6ae1590e1c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e1c86 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644261:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3582cde00/0xd05e6ae1590e20f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e20ed expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644272:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8c200/0xd05e6ae1590e2102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e20fb expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644286:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e1fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e1f9d expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644299:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea341524600/0xd05e6ae1590e230f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e2308 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644313:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f1a00/0xd05e6ae1590e20a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e2099 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644325:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f0e00/0xd05e6ae1590e20ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e20a7 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644335:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e232b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e2324 expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644344:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea341525e00/0xd05e6ae1590e2339 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e2332 expref: 4 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644358:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3429f0800/0xd05e6ae1590e20ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e20c3 expref: 3 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644385:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea38215ec00/0xd05e6ae1590e1c7f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd05e6ae1590e1c78 expref: 2 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349960.644397:0:7458:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ea358202800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783349960.644412:0:7458:0:(genops.c:906:class_export_put()) final put ffff8ea358202800/6edd2b87-ce4c-4997-b296-e0eb4341b4ab 00010000:00010000:1.0:1783349960.644419:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349960.644421:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349960.644423:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349960.644456:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ea344c3f000:6511] 1 exiting: rc = 0 00000020:00000080:1.0:1783349960.644534:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea370da3800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783349960.644540:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea370da4800/lustre-MDD0000_UUID 00000020:00000080:1.0:1783349960.644542:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea370da4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783349960.644546:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783349960.644590:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea370da6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783349960.644595:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea358202800/6edd2b87-ce4c-4997-b296-e0eb4341b4ab for MGS 00000020:00000080:1.0:1783349960.644622:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea358200000 for MGS 00000100:00100000:0.0:1783349960.644706:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644716:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644723:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644729:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644736:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644743:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644749:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644757:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644764:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644771:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644778:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644784:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644791:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644798:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644804:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644810:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644816:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644821:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644827:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644833:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644839:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644845:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644851:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644856:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644862:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644876:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644882:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644888:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644895:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644902:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644909:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644915:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644922:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644928:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644934:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644940:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644946:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644952:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644958:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644964:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644970:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644976:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644982:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644987:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.644994:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645000:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645005:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645010:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645016:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645021:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645027:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645032:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645038:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645043:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645049:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645054:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645059:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645064:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645070:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645075:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645085:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645090:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645105:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349960.645111:0:15098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1783349960.646233:0:15098:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea24263b0c0 - data ffff8ea24203aaf8/ffff8ea243032800 00000020:01000000:0.0:1783349960.646380:0:15098:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea3593669c0 - data ffff8ea371086d80/ffff8ea357eea000 00000020:00000080:0.0:1783349960.646917:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1b67 00000020:00000080:0.0:1783349960.646928:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea357f76000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783349960.647640:0:15098:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea3461c1000 from MGS, refs=2 00000020:01000004:0.0:1783349960.647647:0:15098:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea3461c1000 2 00000020:01000004:0.0:1783349960.647651:0:15098:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ea3461c1000 from MGS 00000020:00000080:0.0:1783349960.647684:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349960.647694:0:15098:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1783349960.647698:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea357f72000/MGS 00000020:00000080:0.0:1783349960.647702:0:15098:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea357f72000/MGS for MGS 00000020:01000000:0.0:1783349960.647712:0:15098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1783349960.647814:0:15098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1783349960.647818:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783349960.647825:0:15098:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783349960.647833:0:15098:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ea36ce3d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783349960.647840:0:15098:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8ea370df99c0) has exports, disconnecting them 00000020:00080000:0.0:1783349960.647845:0:15098:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ea36ce3d000), last request at 1783349727 00000020:00000080:0.0:1783349960.647856:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1c32 00000020:00080000:0.0:1783349960.647875:0:15098:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea36ce3d000): rc 0 00000020:00000080:0.0:1783349960.647880:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea36ce3d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783349960.648003:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea357f76000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783349960.651124:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36ce3d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783349960.653298:0:15098:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783349960.653310:0:15098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349960.653316:0:15098:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783349960.653326:0:15098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783349960.653368:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36ce3d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783349960.653548:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349960.653561:0:15098:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1783349960.653567:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea359368000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783349960.653572:0:15098:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea359368000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783349960.653600:0:15098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783349960.653721:0:15098:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea3461c1000 1 00000020:00000080:1.0:1783349960.653729:0:15098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1b59 00000020:00000080:1.0:1783349960.653737:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea357f74800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1783349960.653748:0:15098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783349960.653756:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea357f74800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783349960.653766:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349960.653771:0:15098:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783349960.653776:0:15098:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8ea37b544d40) has no exports 00010000:00010000:0.0:1783349960.844383:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783349960.850112:0:15098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349960.850132:0:15098:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783349960.850171:0:15098:0:(genops.c:906:class_export_put()) final put ffff8ea3461c6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783349960.850178:0:15098:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea3461c6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783349960.850185:0:15098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783349960.850343:0:15098:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ea3461c0800 00000020:02000400:2.0:1783349960.850440:0:15098:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1783349961.094505:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349961.094537:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659534208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783349961.094631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349961.095453:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659534208 00000100:00100000:0.0:1783349961.095467:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659534208 00000100:00100000:0.0:1783349961.095543:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783349961.095554:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659534208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783349961.095596:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783349961.095694:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659534208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349961.095702:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783349961.096112:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659534208:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783349961.097289:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783349961.864326:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349962.884701:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783349963.664940:0:13794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783349963.909293:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349964.677408:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349964.677437:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659534336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783349964.677527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349964.677608:0:11780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659534336 00000100:00100000:1.0:1783349964.677617:0:11780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659534336 00000100:00100000:1.0:1783349964.677687:0:11780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783349964.677696:0:11780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659534336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783349964.677736:0:11780:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783349964.677789:0:11780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659534336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349964.677798:0:11780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1783349964.677821:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349964.677860:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659534336:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783349964.684434:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783349964.684445:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783349964.684471:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349964.684480:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 400 00000100:00080000:2.0:1783349964.684488:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783349964.684497:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ea375e3a800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783349964.684529:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243082d80 x1869977659534592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783349964.684554:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783349964.684557:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783349964.684559:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea375e0f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349964.684563:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 400 00000100:00080000:2.0:1783349964.684566:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783349964.684569:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ea375e0f800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783349964.684582:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243081880 x1869977659534720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783349964.684590:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783349964.684593:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783349964.684594:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea36d8fb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349964.684598:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 400 00000100:00080000:2.0:1783349964.684601:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783349964.684604:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ea36d8fb000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783349964.684614:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243082300 x1869977659534848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783349964.684655:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783349964.684659:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783349964.684667:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea243524000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349964.684671:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 400 00000100:00080000:2.0:1783349964.684674:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783349964.684679:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ea243524000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783349964.684692:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea370d64e00 x1869977659535232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783349964.684747:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659534592:0@lo:38:kworker.0 00000100:00100000:2.0:1783349964.684829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349964.684876:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659534720:0@lo:38:kworker.0 00000100:00100000:2.0:1783349964.684903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349964.684927:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659534848:0@lo:38:kworker.0 00000100:00100000:2.0:1783349964.684948:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349964.684968:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659535232:0@lo:38:kworker.0 00000100:00100000:2.0:1783349964.684988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349964.685033:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659534592 00000100:00100000:2.0:1783349964.685053:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659534592 00000100:00100000:2.0:1783349964.685105:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1783349964.685112:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869977659534592:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783349964.685177:0:6522:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783349964.685226:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869977659534592:12345-0@lo:38:kworker.0 Request processed in 112us (396us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783349964.685233:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1783349964.685259:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659534720 00000100:00100000:2.0:1783349964.685264:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659534720 00000100:00100000:2.0:1783349964.685283:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659534848 00000100:00100000:2.0:1783349964.685286:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659534848 00000100:00100000:2.0:1783349964.685309:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659535232 00000100:00100000:2.0:1783349964.685312:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659535232 00000100:00100000:2.0:1783349964.685323:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1783349964.685328:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659534720:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783349964.685338:0:6519:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783349964.685365:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659534720:12345-0@lo:38:kworker.0 Request processed in 37us (461us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783349964.685372:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1783349964.685383:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1783349964.685387:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659534848:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783349964.685396:0:6519:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783349964.685420:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659534848:12345-0@lo:38:kworker.0 Request processed in 31us (470us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783349964.685425:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1783349964.685436:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783349964.685440:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659535232:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783349964.685448:0:6519:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783349964.685474:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659535232:12345-0@lo:38:kworker.0 Request processed in 33us (485us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783349964.685480:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1783349964.685527:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783349964.685533:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783349964.685536:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659534592:0@lo:38:kworker.0 00000100:00080000:2.0:1783349964.685546:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea375e0f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783349964.685549:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783349964.685559:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659534720:0@lo:38:kworker.0 00000100:00080000:2.0:1783349964.685570:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d8fb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783349964.685573:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783349964.685576:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659534848:0@lo:38:kworker.0 00000100:00080000:2.0:1783349964.685584:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243524000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783349964.685587:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783349964.685590:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659535232:0@lo:38:kworker.0 00000100:00100000:2.0:1783349964.685631:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659535360:0@lo:400:kworker.0 00000100:00100000:2.0:1783349964.685660:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349964.685690:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349964.685696:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659535104:0@lo:400:kworker.0 00000100:00100000:2.0:1783349964.685722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349964.685749:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659535360 00000100:00100000:2.0:1783349964.685753:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659535360 00000100:00100000:2.0:1783349964.685795:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1783349964.685801:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659535360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349964.685846:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659535360:12345-0@lo:400:kworker.0 Request processed in 45us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349964.685853:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1783349964.685873:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659535104 00000100:00100000:2.0:1783349964.685877:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659535104 00000100:00100000:2.0:1783349964.685905:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783349964.685912:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659535104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349964.685943:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659535104:12345-0@lo:400:kworker.0 Request processed in 32us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349964.685959:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1783349964.685981:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349964.685986:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783349964.686007:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659535104:0@lo:400:kworker.0 00010000:00080000:2.0:1783349964.686020:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8ea370d65880 x1869977659535360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349964.686031:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659535360:0@lo:400:kworker.0 00000100:00100000:1.0:1783349964.687267:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659534976:0@lo:400:kworker.0 00000100:00100000:1.0:1783349964.687348:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349964.687397:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349964.687406:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659534464:0@lo:400:kworker.0 00000400:00000100:1.0:1783349964.687439:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869977659534464 offset 0 length 224: 4 00000100:00100000:0.0:1783349964.687784:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659534976 00000100:00100000:0.0:1783349964.687794:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659534976 00000100:00100000:0.0:1783349964.687859:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1783349964.687868:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659534976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349964.687930:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659534976:12345-0@lo:400:kworker.0 Request processed in 63us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349964.687937:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00080000:0.0:1783349964.687968:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783349964.688000:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8ea370d66d80 x1869977659534976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349964.688014:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659534976:0@lo:400:kworker.0 00010000:00010000:0.0:1783349964.935766:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783349965.725770:0:15299:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783349965.752244:0:15299:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1783349965.752305:0:15299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.752321:0:15299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.752329:0:15299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.752337:0:15299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.752365:0:15299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783349965.752371:0:15299:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783349965.752397:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783349965.752402:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783349965.752408:0:15299:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783349965.752414:0:15299:0:(import.c:65:import_set_state_nolock()) ffff8ea375e0f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1783349965.752418:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783349965.752432:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783349965.752435:0:15299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783349965.753274:0:15299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753287:0:15299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753294:0:15299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753300:0:15299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753316:0:15299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783349965.753321:0:15299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753328:0:15299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753334:0:15299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753341:0:15299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753350:0:15299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783349965.753355:0:15299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753375:0:15299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753381:0:15299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753386:0:15299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753393:0:15299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783349965.753398:0:15299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753404:0:15299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753410:0:15299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753416:0:15299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349965.753423:0:15299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:2.0:1783349965.753426:0:15299:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1783349965.753447:0:15299:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1783349965.753451:0:15299:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1783349965.753455:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783349965.753460:0:15299:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1783349965.753467:0:15299:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8ea37f494000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783349965.753479:0:15299:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8ea242410000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783349965.753484:0:15299:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff8ea349e34d40) has exports, disconnecting them 00000020:00080000:2.0:1783349965.753488:0:15299:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ea37f494000), last request at 1783349964 00000020:00000080:2.0:1783349965.753495:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1f65 00000100:00080000:2.0:1783349965.753513:0:15299:0:(import.c:65:import_set_state_nolock()) ffff8ea37f495800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783349965.753560:0:15299:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea37f494000): rc 0 00000020:00000080:2.0:1783349965.753563:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea37f494000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1783349965.753571:0:15299:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ea242410000), last request at 1783349964 00000020:00000080:2.0:1783349965.753574:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1e3f 00000100:00080000:2.0:1783349965.753579:0:15299:0:(import.c:65:import_set_state_nolock()) ffff8ea242410800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783349965.753585:0:15299:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea242410000): rc 0 00000020:00000080:2.0:1783349965.753586:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea242410000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1783349965.753593:0:15299:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9d9841b57ae0 00000100:00080000:2.0:1783349965.753611:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783349965.753615:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1783349965.754389:0:15299:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783349965.754396:0:15299:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1783349965.758400:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783349965.758417:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758430:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349965.758435:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758445:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349965.758452:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349965.758458:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783349965.758461:0:7458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783349965.758464:0:7458:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783349965.758512:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758518:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349965.758558:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758564:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e600/0xd05e6ae1590e20ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e20f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758579:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783349965.758583:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758603:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349965.758606:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758612:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349965.758618:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349965.758623:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783349965.758626:0:7458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1783349965.758627:0:7458:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1783349965.758653:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758658:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349965.758665:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758671:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e20fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e2102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758680:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783349965.758683:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758688:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cdc00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349965.758691:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758703:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349965.758709:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349965.758715:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783349965.758717:0:7458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783349965.758719:0:7458:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783349965.758730:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758735:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349965.758755:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758761:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cdc00/0xd05e6ae1590e1f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1fa4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758774:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349965.758778:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758784:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349965.758787:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758793:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349965.758809:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349965.758814:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783349965.758816:0:7458:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783349965.758818:0:7458:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783349965.758831:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758836:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349965.758842:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758848:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36da8e200/0xd05e6ae1590e2332 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e2339 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758857:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349965.758861:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758866:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea341525a00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783349965.758869:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758875:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349965.758880:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349965.758893:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783349965.758895:0:7458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783349965.758896:0:7458:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783349965.758909:0:7458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758914:0:7458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349965.758919:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758925:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea341525a00/0xd05e6ae1590e1c86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd05e6ae1590e1c8d expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349965.758938:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349965.758939:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349965.758941:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349965.759030:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659535744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783349965.759108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349965.759198:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349965.759205:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659535872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783349965.759229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783349965.759309:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783349965.759314:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1783349965.759325:0:15299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783349965.759387:0:15299:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783349965.759402:0:15299:0:(import.c:65:import_set_state_nolock()) ffff8ea37f442800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783349965.759412:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783349965.759415:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1783349965.759431:0:15299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783349965.759498:0:15299:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783349965.759508:0:15299:0:(import.c:65:import_set_state_nolock()) ffff8ea36da91000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783349965.759531:0:15299:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8ea349e34d40) has no exports 00000100:00100000:3.0:1783349965.759938:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659535616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349965.759975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349965.760012:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783349965.760018:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659535488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349965.760036:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349965.760051:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659536000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349965.760080:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349965.760106:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659535744 00000100:00100000:3.0:1783349965.760113:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659535744 00000100:00100000:3.0:1783349965.760165:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659535872 00000100:00100000:3.0:1783349965.760169:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659535872 00000100:00100000:3.0:1783349965.760189:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659535616 00000100:00100000:3.0:1783349965.760191:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659535616 00000100:00100000:3.0:1783349965.760197:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659535488 00000100:00100000:3.0:1783349965.760199:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659535488 00000100:00100000:3.0:1783349965.760205:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659536000 00000100:00100000:3.0:1783349965.760206:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659536000 00000100:00100000:3.0:1783349965.760217:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783349965.760223:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1869977659535744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783349965.760229:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783349965 with bad export cookie 15014555723794094972 00000100:00100000:0.0:1783349965.760521:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783349965.760539:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea3525c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3646:x1869977659535872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783349965.760545:0:13183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783349965 with bad export cookie 15014555723794094972 00000100:00100000:0.0:1783349965.760598:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea3525c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3646:x1869977659535872:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1366us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783349965.760605:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783349965.760627:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783349965.760631:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1869977659535616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783349965.760635:0:13183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783349965 with bad export cookie 15014555723794094972 00000100:00100000:0.0:1783349965.760683:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1869977659535616:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (708us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783349965.760689:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783349965.760700:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783349965.760704:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1869977659535488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783349965.760708:0:13183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783349965 with bad export cookie 15014555723794094972 00000100:00100000:0.0:1783349965.760730:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1869977659535488:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (692us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783349965.760735:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783349965.760745:0:13183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783349965.760749:0:13183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1869977659536000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783349965.760752:0:13183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783349965 with bad export cookie 15014555723794094972 00000100:00100000:0.0:1783349965.760769:0:13183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1869977659536000:12345-0@lo:103:ldlm_bl.0 Request processed in 20us (689us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783349965.760774:0:13183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1783349965.760792:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349965.760798:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783349965.760881:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783349965.760886:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ea359385000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783349965.760890:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1783349965.761321:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659536128:0@lo:9:umount.0 00000100:00100000:2.0:1783349965.761370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349965.761393:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659536256:0@lo:9:umount.0 00000100:00100000:2.0:1783349965.761413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349965.761442:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659536128 00000100:00100000:2.0:1783349965.761446:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659536128 00000100:00100000:2.0:1783349965.761476:0:9981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659536256 00000100:00100000:2.0:1783349965.761479:0:9981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659536256 00000100:00100000:2.0:1783349965.761498:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783349965.761505:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1869977659536128:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783349965.761604:0:9981:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1e8c 00000100:00080000:2.0:1783349965.761615:0:9981:0:(import.c:65:import_set_state_nolock()) ffff8ea36da90800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783349965.761725:0:9981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1783349965.761851:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3645:x1869977659536128:12345-0@lo:9:umount.0 Request processed in 346us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349965.761858:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783349965.761872:0:9981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783349965.761878:0:9981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1869977659536256:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783349965.761889:0:9981:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1fdc 00000100:00080000:2.0:1783349965.761895:0:9981:0:(import.c:65:import_set_state_nolock()) ffff8ea375e08000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783349965.761913:0:9981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1783349965.761986:0:9981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3645:x1869977659536256:12345-0@lo:9:umount.0 Request processed in 109us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349965.761993:0:9981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1783349965.762029:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea37f442800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783349965.762040:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783349965.762042:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783349965.762044:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659536128:0@lo:9:umount.0 00000100:00080000:2.0:1783349965.765718:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36da91000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783349965.765746:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783349965.765749:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783349965.765755:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659536256:0@lo:9:umount.0 00010000:00010000:2.0:1783349965.765811:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783349965.768921:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1783349965.770259:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1869977659535744:12345-0@lo:103:ldlm_bl.0 Request processed in 10030us (11147us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783349965.770270:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00000080:3.0:1783349965.778720:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f494000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1783349965.778795:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea242410000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1783349965.778819:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea37f495800 for lustre-MDT0001 00000020:00000080:3.0:1783349965.778824:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea242410800 for lustre-MDT0001 00010000:00010000:1.0:1783349965.788202:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783349965.814000:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.150@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783349965.814006:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783349965.814015:0:3646:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243081180 x1869977659534464/t0(0) o400->MGC192.168.203.150@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783349980 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349965.814030:0:3646:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea24465c700 x1869977659535744/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783349981 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349965.814040:0:3646:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea24465df80 x1869977659535872/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783349981 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349965.814078:0:3646:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea24465dc00 x1869977659535616/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783349981 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349965.814086:0:3646:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea241da4700 x1869977659535488/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783349981 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349965.814095:0:3646:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea24465e680 x1869977659536000/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783349981 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783349965.817228:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ea359385000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1783349965.817374:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659536000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349965.817385:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659535616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349965.817393:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659534464:0@lo:400:kworker.0 00000100:00100000:3.0:1783349965.817427:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3649:1869977659535488:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1783349965.818219:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783349965.818225:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783349965.818227:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783349965.818230:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ea359385000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783349965.818237:0:3646:0:(import.c:512:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 167 00000100:00080000:0.0:1783349965.818245:0:3646:0:(import.c:626:import_select_connection()) MGC192.168.203.150@tcp: import ffff8ea359385000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349965.818890:0:3646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243bad180 x1869977659536384/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349965.818933:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659535744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349965.818950:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3646:1869977659535872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349965.818999:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3645:1869977659536384:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1783349965.819048:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869977659536384 offset 0 length 520: 4 00000020:00080000:3.0:1783349965.819559:0:15299:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8ea349e34d40) has no exports 00000020:01000000:0.0:1783349965.890453:0:15299:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea36cd9fe40 - data ffff8ea371291360/ffff8ea243869400 00000020:01000000:0.0:1783349965.890865:0:15299:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea36d8d27e0 - data ffff8ea3711c40d8/ffff8ea36da89000 00000001:00000004:2.0:1783349965.917837:0:15299:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:0.0:1783349965.958357:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783349965.975710:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349965.975724:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1783349965.975737:0:15299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783349965.983724:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783349965.983735:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1783349965.983762:0:15299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783349965.983765:0:15299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783349965.986152:0:8579:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783349965.986164:0:8579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1783349965.986185:0:8579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1783349965.986863:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783349965.986881:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1783349965.986902:0:15299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783349965.986905:0:15299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783349965.988294:0:9979:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783349965.988305:0:9979:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1783349965.988323:0:9979:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783349965.999568:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1ca9 00000020:00000080:1.0:1783349965.999586:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea36d137000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783349966.000583:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d137000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1783349966.006941:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1cbe 00000020:00000080:2.0:1783349966.006966:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea36d137800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1783349966.007026:0:15299:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1783349966.007033:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783349966.007060:0:15299:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783349966.007068:0:15299:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8ea349e30000) has no exports 00000004:01000000:2.0:1783349966.007573:0:15299:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783349966.007585:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1fc7 00000020:00000080:2.0:1783349966.007590:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea2434de000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783349966.010910:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d137800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1783349966.011662:0:15299:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1783349966.011710:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783349966.011729:0:15299:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783349966.011735:0:15299:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff8ea36d144d40) has no exports 00000020:00000080:2.0:1783349966.011748:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1fc0 00000020:00000080:2.0:1783349966.011759:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea36d135800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1783349966.012617:0:15299:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1783349966.012625:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783349966.012631:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1783349966.012639:0:15299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783349966.012642:0:15299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783349966.012740:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349966.012752:0:15299:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783349966.012762:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1e85 00000020:00000080:2.0:1783349966.012770:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea242416800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1783349966.012793:0:15299:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1783349966.012798:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349966.012799:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea2434de000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1783349966.012803:0:15299:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783349966.012808:0:15299:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff8ea37f458000) has no exports 00000020:00000080:2.0:1783349966.012816:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1e7e 00000020:00000080:2.0:1783349966.012821:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea36d8fe000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783349966.012821:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d135800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1783349966.013584:0:15299:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1783349966.013590:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783349966.013594:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1783349966.013600:0:15299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783349966.013602:0:15299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783349966.015381:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36da91000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1783349966.015403:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea37f495000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783349966.015408:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f495000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1783349966.015418:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783349966.018495:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea242416800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1783349966.018514:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d8fe000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1783349966.018861:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349966.018881:0:15299:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1783349966.018906:0:15299:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783349966.018916:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1ce1 00000020:00000080:2.0:1783349966.018927:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea36ccdb000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1783349966.018934:0:15299:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1783349966.018945:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783349966.018950:0:15299:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783349966.018955:0:15299:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8ea37b543380) has no exports 00000020:00000080:2.0:1783349966.018964:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1cda 00000020:00000080:2.0:1783349966.018968:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea375e3d000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783349966.019471:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea37f442800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1783349966.019483:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea242411800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783349966.019486:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea242411800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1783349966.019493:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783349966.019797:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36ccdb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1783349966.019804:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e3d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1783349966.071129:0:15299:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1783349966.071154:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783349966.071185:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1783349966.071198:0:15299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783349966.071286:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349966.071303:0:15299:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783349966.071363:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349966.071367:0:15299:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783349966.071374:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea37b61b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783349966.071380:0:15299:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37b61b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1783349966.071399:0:15299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783349966.071636:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1cc5 00000020:00000080:0.0:1783349966.071644:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea36d136800/lustre-MDD0001_UUID 00000020:01000000:0.0:1783349966.071650:0:15299:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1783349966.071655:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783349966.071659:0:15299:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783349966.071664:0:15299:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff8ea36d143380) has no exports 00000020:00000080:0.0:1783349966.071690:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349966.071693:0:15299:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1783349966.071698:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1ccc 00000020:00000080:0.0:1783349966.071702:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea36d132000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1783349966.071712:0:15299:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea357ed9800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1783349966.071715:0:15299:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea357ed9800 2 00000020:01000004:0.0:1783349966.071719:0:15299:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ea357ed9800 from lustre-MDT0001 00000020:00000080:0.0:1783349966.071739:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349966.071742:0:15299:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1783349966.071745:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea36d133000/lustre-MDT0001_UUID 00000020:00000080:0.0:1783349966.071747:0:15299:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d133000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1783349966.071755:0:15299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1783349966.071788:0:15299:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1783349966.071793:0:15299:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1783349966.071796:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783349966.071800:0:15299:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783349966.071808:0:15299:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8ea375e09800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783349966.071833:0:15299:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff8ea37b540000) has exports, disconnecting them 00000020:00080000:0.0:1783349966.071839:0:15299:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8ea375e09800), last request at 1783349742 00000020:00000080:0.0:1783349966.071842:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1d20 00000020:00000080:1.0:1783349966.071906:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea375e3a800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1783349966.071914:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea36ccda800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783349966.071916:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36ccda800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1783349966.071925:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783349966.072043:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d136800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1783349966.072048:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea36d130000/lustre-MDD0001_UUID 00000020:00000080:1.0:1783349966.072050:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d130000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1783349966.072063:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1783349966.072304:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d132000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00080000:0.0:1783349966.072559:0:15299:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea375e09800): rc 0 00000020:00000080:0.0:1783349966.072567:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea375e09800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783349966.073202:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e09800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1783349966.109808:0:15299:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1783349966.109822:0:15299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349966.109828:0:15299:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783349966.109838:0:15299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783349966.109893:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea375e0f800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783349966.110100:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349966.110111:0:15299:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1783349966.110117:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea375e3d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1783349966.110122:0:15299:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e3d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1783349966.110129:0:15299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1783349966.110249:0:15299:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea357ed9800 1 00000020:00000080:1.0:1783349966.110258:0:15299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1c5c 00000020:00000080:1.0:1783349966.110268:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea36cf58000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1783349966.110278:0:15299:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1783349966.110286:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36cf58000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783349966.110297:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349966.110303:0:15299:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783349966.110308:0:15299:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8ea349e33380) has no exports 00000020:00000080:1.0:1783349966.320338:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349966.320368:0:15299:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1783349966.320375:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea3471d0000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783349966.320381:0:15299:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea3471d0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1783349966.320396:0:15299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1783349966.320560:0:15299:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ea3471d7000 00000020:01000000:1.0:1783349966.320586:0:15299:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1783349966.320590:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349966.320595:0:15299:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783349966.320600:0:15299:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8ea349f88000) has no exports 00000100:00100000:3.0:1783349966.321390:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ea348dbe800:6519] 2 exiting: rc = 0 00000100:00100000:3.0:1783349966.321558:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8ea350852800:6517] 0 exiting: rc = 1 00000100:00100000:0.0:1783349966.321662:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8ea348dbe400:6518] 1 exiting: rc = 0 00000100:00100000:0.0:1783349966.321762:0:8582:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8ea241da0000:8582] 3 exiting: rc = 0 00000100:00100000:2.0:1783349966.321944:0:12147:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8ea36daa6a00:12147] 4 exiting: rc = 0 00000100:00100000:1.0:1783349966.322567:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322580:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322587:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322593:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322599:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322605:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322611:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322617:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322624:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322629:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322635:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322641:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322647:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322654:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322660:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322666:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322673:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322680:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322687:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322693:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322700:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322706:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322713:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322718:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322726:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322747:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322752:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322760:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322766:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322772:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322777:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322783:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322788:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322795:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322801:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322809:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322815:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322821:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322827:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322835:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322841:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322847:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322852:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322859:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322865:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322871:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322877:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322883:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322889:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322896:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322903:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322909:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322916:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322923:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322928:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322935:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322940:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322946:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322952:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322959:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322972:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322978:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.322984:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349966.323003:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.327600:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8ea348dbfa00:6521] 1 exiting: rc = 0 00000100:00100000:2.0:1783349966.327890:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8ea348dbea00:6520] 0 exiting: rc = 1 00000100:00100000:0.0:1783349966.328015:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328028:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328046:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328061:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328069:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328075:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328083:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328090:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328097:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328103:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328109:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328117:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328123:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328129:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328168:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328175:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328181:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328187:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328194:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328200:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328205:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328210:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328216:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328222:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328228:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328233:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328259:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328265:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328270:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328276:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328282:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328287:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328293:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328298:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328305:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328311:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328317:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328323:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328329:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328335:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328341:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328347:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328354:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328360:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328366:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328373:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328379:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328385:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328391:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328397:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328402:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328408:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328414:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328420:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328426:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328432:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328438:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328443:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328449:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328454:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328459:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328472:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328479:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.328486:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329126:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8ea348dbe200:6523] 1 exiting: rc = 0 00000100:00100000:2.0:1783349966.329352:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8ea348dbfc00:6522] 0 exiting: rc = 1 00000100:00100000:2.0:1783349966.329428:0:7578:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8ea36d916400:7578] 2 exiting: rc = 0 00000100:00100000:3.0:1783349966.329530:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329553:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329559:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329566:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329573:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329581:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329587:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329594:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329601:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329608:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329615:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329622:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329629:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329649:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329657:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329664:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329671:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329678:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329684:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329690:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329696:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329702:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329710:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329716:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329722:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329742:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329749:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329756:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329761:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329767:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329773:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329779:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329786:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329792:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329798:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329803:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329816:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329836:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329842:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329849:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329854:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329860:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329866:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329872:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329878:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329884:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329890:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329898:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329905:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329925:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329932:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329939:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329946:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329952:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329959:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329965:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329972:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329979:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329986:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329992:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.329999:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.330005:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.330011:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.330026:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349966.348338:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8ea349f10800:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1783349966.348758:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8ea349f10400:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1783349966.348818:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348827:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348833:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348839:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348844:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348850:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348856:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348874:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348879:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348884:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348890:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348896:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348901:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348907:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348913:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348918:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348923:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348929:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348935:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348941:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348947:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348952:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348957:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.348963:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349036:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349042:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349047:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349064:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349069:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349074:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349080:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349085:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349091:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349096:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349102:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349108:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349114:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349121:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349126:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349132:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349160:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349167:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349252:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349258:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349264:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349270:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349275:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349281:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349287:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349293:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349298:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349304:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349310:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349315:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349321:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349326:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349332:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349337:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349343:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349348:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349354:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349359:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349364:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.349370:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.350239:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8ea349f11000:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1783349966.350378:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8ea349f11a00:6527] 1 exiting: rc = 0 00000100:00100000:3.0:1783349966.350476:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350484:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350490:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350495:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350500:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350506:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350512:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350518:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350643:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350650:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350656:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350662:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350667:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350689:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350696:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350702:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350708:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350713:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350719:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350725:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350731:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350738:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350744:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350750:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350756:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350762:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350769:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350775:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350781:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350787:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350793:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350799:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350804:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350809:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350815:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350822:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350828:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350833:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350839:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350845:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350851:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350857:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350864:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350869:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350875:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350880:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350886:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350891:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350905:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350910:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350916:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350922:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350927:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350932:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350938:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350944:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350949:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350955:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.350961:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.351032:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.351039:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.351045:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.351059:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.351064:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.351847:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8ea349f10200:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1783349966.351959:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8ea349f11200:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1783349966.352188:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352195:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352200:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352205:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352210:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352214:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352220:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352225:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352231:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352237:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352243:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352248:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352254:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352260:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352267:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352272:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352278:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352283:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352288:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352306:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352312:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352318:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352324:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352330:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352335:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352340:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352345:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352351:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352356:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352361:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352366:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352371:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352376:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352381:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352387:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352392:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352398:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352403:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352409:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352413:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352418:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352423:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352428:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352433:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352438:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352443:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352448:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352453:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352457:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352463:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352469:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352473:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352479:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352485:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352498:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352502:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352507:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352513:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352519:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352535:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352541:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352546:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352551:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349966.352555:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.353323:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8ea348dbf600:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1783349966.354819:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8ea3454bc600:6531] 1 exiting: rc = 0 00000100:00100000:1.0:1783349966.356650:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8ea348cf3c00:6532] 2 exiting: rc = 0 00000100:00100000:0.0:1783349966.356927:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.356937:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.356943:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.356959:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.356966:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.356986:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357000:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357117:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357126:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357164:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357174:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357197:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357204:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357210:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357216:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357223:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357229:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357234:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357240:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357252:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357259:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357266:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357290:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357298:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357305:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357312:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357326:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357352:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357358:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357370:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357379:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357386:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357393:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357401:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357408:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357414:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357421:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357428:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357435:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357442:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357449:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357455:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357463:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357469:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357476:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357484:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357507:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357515:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357653:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357664:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357670:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357676:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357682:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357688:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357694:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357700:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357705:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357712:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357718:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357724:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357731:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357737:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357751:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349966.357757:0:15299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783349966.378600:0:15299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349966.378619:0:15299:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1783349966.378626:0:15299:0:(genops.c:906:class_export_put()) final put ffff8ea359380800/MDS_uuid 00000020:00000080:0.0:1783349966.378632:0:15299:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea359380800/MDS_uuid for MDS 00000020:01000000:0.0:1783349966.378645:0:15299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1783349966.378832:0:15299:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1783349966.980650:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349968.009396:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349969.029075:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783349969.801819:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783349969.801828:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783349969.801831:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783349969.801835:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783349969.801839:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea36d8fb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783349969.801846:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 405 00000100:00080000:0.0:1783349969.801852:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783349969.801860:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ea36d8fb000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349969.802461:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243baea00 x1869977659536512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783349969.802516:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783349969.802519:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783349969.802521:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea243524000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783349969.802526:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 405 00000100:00080000:0.0:1783349969.802529:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783349969.802534:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ea243524000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783349969.802548:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243bac380 x1869977659536768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349969.802599:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783349969.802615:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659536640:0@lo:400:kworker.0 00000100:00100000:2.0:1783349969.802839:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659536512:0@lo:38:kworker.0 00000400:00000100:0.0:1783349969.802880:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659536640 offset 0 length 224: 4 00000100:00100000:3.0:1783349969.804253:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659536896:0@lo:400:kworker.0 00000400:00000100:2.0:1783349969.808792:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659536512 offset 0 length 520: 4 00000100:00100000:2.0:1783349969.808856:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659536768:0@lo:38:kworker.0 00000400:00000100:2.0:1783349969.808924:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659536768 offset 0 length 520: 4 00000400:00000100:3.0:1783349969.813857:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659536896 offset 0 length 224: 4 00010000:00010000:1.0:1783349970.055983:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783349970.515544:0:15500:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783349970.528335:0:15500:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1783349970.528387:0:15500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349970.528401:0:15500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349970.528409:0:15500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349970.528416:0:15500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349970.528439:0:15500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783349970.528444:0:15500:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783349970.528472:0:15500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349970.528483:0:15500:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243baea00 x1869977659536512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783349989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349970.528512:0:15500:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783349970.528518:0:15500:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783349970.528525:0:15500:0:(import.c:65:import_set_state_nolock()) ffff8ea36d8fb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1783349970.528543:0:15500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349970.528547:0:15500:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243baea00 x1869977659536512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783349989 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349970.528555:0:15500:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783349970.528558:0:15500:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:0.0:1783349970.528695:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349970.528703:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349970.528712:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cce00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349970.528716:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349970.528725:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349970.528933:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349970.528939:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783349970.528942:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783349970.528944:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783349970.528956:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea359385000 00010000:00010000:0.0:1783349970.528962:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349970.528969:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cce00/0xd05e6ae1590e20c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e20ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349970.528980:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349970.528982:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349970.528989:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349970.533124:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659536512:0@lo:38:kworker.0 00000100:00080000:1.0:1783349970.533977:0:15500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783349970.533988:0:15500:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243bad500 x1869977659536640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349985 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349970.534013:0:15500:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1783349970.534518:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659536640:0@lo:400:kworker.0 00000100:00080000:1.0:1783349970.534606:0:15500:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783349970.544181:0:15500:0:(import.c:65:import_set_state_nolock()) ffff8ea242414800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783349970.547643:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869977659537024:0@lo:39:umount.0 00000400:00000100:3.0:1783349970.547705:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659537024 offset 0 length 224: 4 00000100:00080000:0.0:1783349970.820352:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783349970.820361:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783349970.820364:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783349970.820367:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783349970.820479:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349970.820498:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659537152:0@lo:400:kworker.0 00000400:00000100:1.0:1783349970.820547:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659537152 offset 0 length 224: 4 00010000:00010000:0.0:1783349971.077401:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783349971.335561:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783349971.335571:0:9511:0:(genops.c:906:class_export_put()) final put ffff8ea375e0b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783349971.335970:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e0b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783349971.336452:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea375e08000 for lustre-OST0001 00000001:00100000:3.0:1783349971.336547:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783349971.336552:0:8426:0:(genops.c:906:class_export_put()) final put ffff8ea36da96800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783349971.336612:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36da96800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783349971.336643:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36da90800 for lustre-OST0000 00010000:00010000:1.0:1783349972.100295:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349973.124466:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349974.148349:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783349974.853593:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783349974.853604:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783349974.853611:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783349974.853614:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783349974.853769:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659537280:0@lo:400:kworker.0 00000400:00000100:0.0:1783349974.853831:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659537280 offset 0 length 224: 4 00010000:00010000:1.0:1783349975.172696:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349975.684767:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783349965/real 1783349965] req@ffff8ea243bad180 x1869977659536384/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783349975 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349975.684799:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea243bad180 x1869977659536384/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783349975 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783349975.684819:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea359385000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783349975.684846:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783349975.684850:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3645:1869977659536384:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1783349975.685726:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783349975.685733:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783349975.685736:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea359385000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783349975.685741:0:8:0:(import.c:512:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 406 00000100:00080000:1.0:1783349975.685747:0:8:0:(import.c:591:import_select_connection()) MGC192.168.203.150@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783349975.685754:0:8:0:(import.c:626:import_select_connection()) MGC192.168.203.150@tcp: import ffff8ea359385000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783349975.685787:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244525500 x1869977659537408/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783349975.685812:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783349975.685829:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783349975.685967:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659537536:0@lo:400:kworker.0 00000400:00000100:2.0:1783349975.686030:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659537536 offset 0 length 224: 4 00000100:00100000:3.0:1783349975.686374:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3645:1869977659537408:0@lo:250:kworker.0 00000400:00000100:3.0:1783349975.686400:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869977659537408 offset 0 length 520: 4 00010000:00010000:0.0:1783349976.196486:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349977.220392:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349978.244639:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349979.268456:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349980.292314:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349980.804934:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783349970/real 1783349970] req@ffff8ea244525180 x1869977659537024/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783349980 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349980.804978:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea244525180 x1869977659537024/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783349980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783349980.804998:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea242414800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783349980.805080:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869977659537024:0@lo:39:umount.0 00000100:00080000:1.0:1783349980.808121:0:15500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783349980.808131:0:15500:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783349980.808149:0:15500:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783349980.810123:0:15500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349980.810166:0:15500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349980.810173:0:15500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349980.810179:0:15500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349980.810272:0:15500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349980.810281:0:15500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349980.810288:0:15500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349980.810295:0:15500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349980.810308:0:15500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349980.810649:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349980.810658:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349980.810665:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349980.810669:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349980.810678:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349980.810685:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349980.810691:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783349980.810694:0:7458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1783349980.810705:0:7458:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea359385000 00010000:00010000:2.0:1783349980.810716:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349980.810722:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd600/0xd05e6ae1590e20d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e20d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349980.810738:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349980.810742:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349980.810747:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:2.0:1783349980.810750:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349980.810757:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349980.810764:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349980.810769:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783349980.810771:0:7458:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1783349980.810776:0:7458:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea359385000 00010000:00010000:2.0:1783349980.810779:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349980.810797:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349980.810798:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349980.810800:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349980.810971:0:15500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783349980.810982:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cd800/0xd05e6ae1590e2324 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e232b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349980.810993:0:15500:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1783349980.810998:0:15500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1783349980.811001:0:15500:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1783349980.811027:0:15500:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783349980.811031:0:15500:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1783349980.811037:0:15500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349980.811042:0:15500:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783349980.811046:0:15500:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8ea241dcb380) has no exports 00000020:00080000:1.0:1783349980.811070:0:15500:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8ea241dcb380) has no exports 00010000:00010000:0.0:1783349980.811687:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783349980.819976:0:15500:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea2436838a0 - data ffff8ea242106360/ffff8ea36dfeb000 00000020:01000000:1.0:1783349980.820117:0:15500:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea241f0a600 - data ffff8ea3711d5d80/ffff8ea242721800 00100000:10000000:1.0:1783349980.854684:0:15500:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783349980.870045:0:15500:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1df9 00000020:00000080:1.0:1783349980.870058:0:15500:0:(genops.c:906:class_export_put()) final put ffff8ea375e07000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783349980.870117:0:15500:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea36d918000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783349980.870121:0:15500:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea36d918000 2 00000020:01000004:1.0:1783349980.870124:0:15500:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ea36d918000 from lustre-OST0000 00000020:00000080:1.0:1783349980.870187:0:15500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349980.870197:0:15500:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783349980.870200:0:15500:0:(genops.c:906:class_export_put()) final put ffff8ea359383000/lustre-OST0000_UUID 00000020:00000080:1.0:1783349980.870204:0:15500:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea359383000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783349980.870210:0:15500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783349980.870258:0:15500:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783349980.870263:0:15500:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783349980.870266:0:15500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349980.870278:0:15500:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783349980.870284:0:15500:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ea242416000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783349980.870289:0:15500:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff8ea2424499c0) has exports, disconnecting them 00000020:00080000:1.0:1783349980.870294:0:15500:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ea242416000), last request at 1783349759 00000020:00000080:1.0:1783349980.870298:0:15500:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1e23 00000020:00080000:1.0:1783349980.870307:0:15500:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea242416000): rc 0 00000020:00000080:1.0:1783349980.870312:0:15500:0:(genops.c:906:class_export_put()) final put ffff8ea242416000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783349980.875100:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea375e07000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783349980.876256:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea242416000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1783349980.880823:0:15500:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783349980.880832:0:15500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783349980.880837:0:15500:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783349980.880845:0:15500:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783349980.881011:0:15500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783349980.881021:0:15500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1783349980.881028:0:15500:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783349980.881032:0:15500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783349980.881036:0:15500:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783349980.881044:0:15500:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8ea242411000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783349980.881050:0:15500:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff8ea37f45b380) has exports, disconnecting them 00000020:00080000:3.0:1783349980.881054:0:15500:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8ea242411000), last request at 1783349759 00000020:00000080:3.0:1783349980.881058:0:15500:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1e38 00000020:00080000:3.0:1783349980.881073:0:15500:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea242411000): rc 0 00000020:00000080:3.0:1783349980.881079:0:15500:0:(genops.c:906:class_export_put()) final put ffff8ea242411000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783349980.927336:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea36d8fb000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783349980.927354:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea37f443800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1783349980.927358:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f443800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1783349980.927372:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1783349980.927451:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea242411000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1783349980.983213:0:15500:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1783349980.983223:0:15500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783349980.983228:0:15500:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783349980.983235:0:15500:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783349980.983672:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea242414800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783349980.983987:0:15500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349980.983997:0:15500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1783349980.984002:0:15500:0:(genops.c:906:class_export_put()) final put ffff8ea242413800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1783349980.984006:0:15500:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea242413800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1783349980.984016:0:15500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1783349980.984081:0:15500:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea36d918000 1 00000020:00000080:1.0:1783349980.984087:0:15500:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1dc1 00000020:00000080:1.0:1783349980.984094:0:15500:0:(genops.c:906:class_export_put()) final put ffff8ea36d8fc800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1783349980.984105:0:15500:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1783349980.984113:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d8fc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783349980.984123:0:15500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349980.984210:0:15500:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783349980.984216:0:15500:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff8ea370dfb380) has no exports 00000020:00000080:1.0:1783349981.053483:0:15500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349981.053496:0:15500:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1783349981.053502:0:15500:0:(genops.c:906:class_export_put()) final put ffff8ea36d918800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1783349981.053506:0:15500:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d918800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1783349981.053512:0:15500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1783349981.053726:0:15500:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ea36d91b000 00000020:02000400:1.0:1783349981.053769:0:15500:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1783349981.061777:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783349981.061953:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783349981.061956:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783349981.061959:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783349981.062526:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659537664:0@lo:400:kworker.0 00000400:00000100:1.0:1783349981.062959:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659537664 offset 0 length 224: 4 00010000:00010000:0.0:1783349981.325178:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349982.347356:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349983.370745:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349984.398733:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1783349985.156213:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783349969/real 1783349969] req@ffff8ea243badc00 x1869977659536896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783349985 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.183821:0:3646:0:(client.c:2533:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8ea243badc00 x1869977659536896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783349985 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783349985.183835:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ea243520000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783349985.183840:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783349985.192445:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1783349985.192510:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659536896:0@lo:400:kworker.0 00000100:00080000:2.0:1783349985.192593:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783349985.192599:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783349985.192601:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783349985.192604:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783349985.192607:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783349985.192610:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783349985.192614:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea243520000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349985.192619:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 218 00000100:00080000:2.0:1783349985.192627:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ea243520000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783349985.192660:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243080e00 x1869977659537792/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783349985.192730:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869977659537792:0@lo:38:kworker.0 00000400:00000100:1.0:1783349985.192786:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977659537792 offset 0 length 520: 4 00000020:01000004:1.0:1783349985.219832:0:15702:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783349985.243306:0:15702:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1783349985.243409:0:15702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.243427:0:15702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.243435:0:15702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.243442:0:15702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.243461:0:15702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783349985.243466:0:15702:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783349985.243502:0:15702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349985.243515:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243bac380 x1869977659536768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783349989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.243540:0:15702:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783349985.243546:0:15702:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783349985.243552:0:15702:0:(import.c:65:import_set_state_nolock()) ffff8ea243524000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1783349985.243556:0:15702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349985.243560:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243bac380 x1869977659536768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783349989 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.243566:0:15702:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783349985.243569:0:15702:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:3.0:1783349985.243802:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659536768:0@lo:38:kworker.0 00010000:00010000:0.0:1783349985.245389:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349985.245401:0:7458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349985.245413:0:7458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783349985.245417:0:7458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349985.245447:0:7458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349985.245454:0:7458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349985.245460:0:7458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783349985.245463:0:7458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783349985.245467:0:7458:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783349985.245485:0:7458:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea359385000 00010000:00010000:0.0:1783349985.245500:0:7458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349985.245506:0:7458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc800/0xd05e6ae1590e2099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e20a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349985.245519:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349985.245520:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349985.245522:0:7458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783349985.245667:0:15702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783349985.245685:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243bad500 x1869977659537152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349986 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.245709:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243081f80 x1869977659537280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349990 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.245765:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea244527b80 x1869977659537536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.245782:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea244525f80 x1869977659537664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349997 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.245789:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243080e00 x1869977659537792/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783349995 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.245800:0:15702:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783349985.245805:0:15702:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783349985.245811:0:15702:0:(import.c:65:import_set_state_nolock()) ffff8ea243520000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1783349985.245816:0:15702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783349985.245819:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243bad500 x1869977659537152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349986 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.245827:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243081f80 x1869977659537280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349990 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349985.245881:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659537536:0@lo:400:kworker.0 00000100:00100000:2.0:1783349985.246089:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869977659537280:0@lo:400:kworker.0 00000100:00100000:1.0:1783349985.246118:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea244527b80 x1869977659537536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349991 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.246126:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea244525f80 x1869977659537664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349997 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349985.246173:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659537664:0@lo:400:kworker.0 00000100:00100000:1.0:1783349985.246179:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea243080e00 x1869977659537792/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783349995 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349985.246192:0:15702:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783349985.246351:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869977659537792:0@lo:38:kworker.0 00000100:00100000:1.0:1783349985.253764:0:15702:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:0.0:1783349985.253786:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659537152:0@lo:400:kworker.0 00010000:00010000:1.0:1783349985.255442:0:15702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.255471:0:15702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.255479:0:15702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.255485:0:15702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.255558:0:15702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349985.255567:0:15702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.255573:0:15702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.255579:0:15702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349985.255585:0:15702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349985.255609:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783349985.255703:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349985.255709:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc400 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:3.0:1783349985.255713:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349985.255722:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349985.255729:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349985.255734:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783349985.255737:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1783349985.255749:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea359385000 00010000:00010000:3.0:1783349985.255753:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349985.255760:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3582cc400/0xd05e6ae1590e20a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e20ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349985.255772:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349985.255776:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349985.255782:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:3.0:1783349985.255785:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349985.255790:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349985.255802:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349985.255807:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783349985.255810:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1783349985.255814:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea359385000 00010000:00010000:3.0:1783349985.255817:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349985.255823:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349985.255825:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349985.255826:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349985.255864:0:15702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783349985.255869:0:15702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e2308 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e230f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349985.255883:0:15702:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1783349985.255888:0:15702:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1783349985.255898:0:15702:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1783349985.255937:0:15702:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1783349985.255941:0:15702:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1783349985.255945:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349985.255949:0:15702:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783349985.255953:0:15702:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8ea24244cd40) has no exports 00000020:00080000:1.0:1783349985.255975:0:15702:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8ea24244cd40) has no exports 00010000:00010000:0.0:1783349985.258042:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783349985.260710:0:15702:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea243683c60 - data ffff8ea242106bd0/ffff8ea36dfe9400 00000020:01000000:1.0:1783349985.260851:0:15702:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ea375fd1ae0 - data ffff8ea24203a870/ffff8ea243256c00 00100000:10000000:1.0:1783349985.277052:0:15702:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783349985.292256:0:15702:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1f1f 00000020:00000080:2.0:1783349985.292270:0:15702:0:(genops.c:906:class_export_put()) final put ffff8ea24271f000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1783349985.292300:0:15702:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea36d976000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1783349985.292304:0:15702:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea36d976000 2 00000020:01000004:2.0:1783349985.292308:0:15702:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ea36d976000 from lustre-OST0001 00000020:00000080:2.0:1783349985.292334:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349985.292344:0:15702:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1783349985.292347:0:15702:0:(genops.c:906:class_export_put()) final put ffff8ea36d976800/lustre-OST0001_UUID 00000020:00000080:2.0:1783349985.292349:0:15702:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d976800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1783349985.292355:0:15702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1783349985.292425:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea24271f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1783349985.292492:0:15702:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 6edd2b87-ce4c-4997-b296-e0eb4341b4ab->MGS 00010000:00010000:2.0:1783349985.292507:0:15702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea341524000/0xd05e6ae1590e1c78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e1c7f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349985.292533:0:15702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea341524000/0xd05e6ae1590e1c78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e1c7f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349985.292539:0:15702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1783349985.292542:0:15702:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1783349985.292545:0:15702:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1783349985.292566:0:15702:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea359385000 00010000:00010000:2.0:1783349985.292570:0:15702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea341524000/0xd05e6ae1590e1c78 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e1c7f expref: -99 pid: 7446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349985.292587:0:15702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea38215ea00/0xd05e6ae1590e2141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd05e6ae1590e2148 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349985.292594:0:15702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea38215ea00/0xd05e6ae1590e2141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd05e6ae1590e2148 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349985.292599:0:15702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783349985.292601:0:15702:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1783349985.292603:0:15702:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1783349985.292611:0:15702:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ea359385000 00010000:00010000:2.0:1783349985.292613:0:15702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea38215ea00/0xd05e6ae1590e2141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd05e6ae1590e2148 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783349985.292628:0:15702:0:(import.c:65:import_set_state_nolock()) ffff8ea359385000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1783349985.292632:0:15702:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783349985.292634:0:15702:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783349985.292636:0:15702:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783349985.292639:0:15702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783349985.292649:0:15702:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ea244525500 x1869977659537408/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783349990 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783349985.292676:0:15702:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783349985.292679:0:15702:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:2.0:1783349985.293513:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6edd2b87-ce4c-4997-b296-e0eb4341b4ab:3645:1869977659537408:0@lo:250:kworker.0 10000000:01000000:1.0:1783349985.293843:0:15702:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783349985.293853:0:15702:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1b75 00000020:00000080:1.0:1783349985.293861:0:15702:0:(genops.c:906:class_export_put()) final put ffff8ea359387000/6edd2b87-ce4c-4997-b296-e0eb4341b4ab 00000020:01000000:1.0:1783349985.293884:0:15702:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.150@tcp (flags='') 00000020:00000080:1.0:1783349985.293891:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349985.293896:0:15702:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783349985.293901:0:15702:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8ea349f8b380) has no exports 10000000:01000000:2.0:1783349985.294396:0:6514:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1783349985.294464:0:15702:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.150@tcp: client import never connected 00000020:00000080:2.0:1783349985.294465:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea359387000/6edd2b87-ce4c-4997-b296-e0eb4341b4ab for MGC192.168.203.150@tcp 00000100:00080000:1.0:1783349985.294470:0:15702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1783349985.294474:0:15702:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783349985.294478:0:15702:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1783349985.294480:0:15702:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783349985.294525:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349985.294532:0:15702:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.150@tcp (uuid 6edd2b87-ce4c-4997-b296-e0eb4341b4ab) 00000020:01000000:1.0:1783349985.294538:0:15702:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1783349985.294541:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349985.294545:0:15702:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783349985.294550:0:15702:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8ea243525000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783349985.294556:0:15702:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff8ea243518000) has exports, disconnecting them 00000020:00080000:1.0:1783349985.294561:0:15702:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8ea243525000), last request at 1783349777 00000020:00000080:2.0:1783349985.294562:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea359385000 for MGC192.168.203.150@tcp 00000020:00000080:1.0:1783349985.294567:0:15702:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1f49 00000020:00000080:2.0:1783349985.294571:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea359386800/6edd2b87-ce4c-4997-b296-e0eb4341b4ab 00000020:00000080:2.0:1783349985.294575:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea359386800/6edd2b87-ce4c-4997-b296-e0eb4341b4ab for MGC192.168.203.150@tcp 00000020:01000000:2.0:1783349985.294580:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.150@tcp (6edd2b87-ce4c-4997-b296-e0eb4341b4ab) 00000020:00080000:1.0:1783349985.294594:0:15702:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea243525000): rc 0 00000020:00000080:1.0:1783349985.294598:0:15702:0:(genops.c:906:class_export_put()) final put ffff8ea243525000/lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1783349985.296231:0:15702:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783349985.296239:0:15702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783349985.296244:0:15702:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783349985.296251:0:15702:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783349985.296416:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349985.296424:0:15702:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1783349985.296438:0:15702:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783349985.296441:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783349985.296445:0:15702:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783349985.296451:0:15702:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8ea37f491800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783349985.296456:0:15702:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff8ea24351cd40) has exports, disconnecting them 00000020:00080000:0.0:1783349985.296460:0:15702:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8ea37f491800), last request at 1783349777 00000020:00000080:0.0:1783349985.296464:0:15702:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1f5e 00000020:00080000:0.0:1783349985.296476:0:15702:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ea37f491800): rc 0 00000020:00000080:0.0:1783349985.296482:0:15702:0:(genops.c:906:class_export_put()) final put ffff8ea37f491800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1783349985.301749:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea243525000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783349985.301766:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea243524000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783349985.301773:0:8:0:(genops.c:906:class_export_put()) final put ffff8ea36d972800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1783349985.301776:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d972800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1783349985.301780:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1783349985.301832:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f491800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1783349985.311203:0:15702:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783349985.311211:0:15702:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783349985.311216:0:15702:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783349985.311223:0:15702:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783349985.311256:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ea243520000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1783349985.319219:0:7458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1783349985.336425:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1783349985.336643:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1783349985.336895:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ea349f17800:6500] 0 exiting: rc = 1 00000100:00100000:0.0:1783349985.336991:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ea37b65c400:6501] 1 exiting: rc = 0 00000100:00100000:2.0:1783349985.337086:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.337386:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ea379183400:6502] 0 exiting: rc = 1 00000100:00100000:1.0:1783349985.337492:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8ea350b03c00:6504] 2 exiting: rc = 0 00000100:00100000:0.0:1783349985.337674:0:7459:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8ea36cfcf400:7459] 3 exiting: rc = 0 00000100:00100000:2.0:1783349985.338452:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ea379183800:6503] 1 exiting: rc = 0 00000100:00100000:0.0:1783349985.340275:0:13183:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8ea241da2e00:13183] 4 exiting: rc = 0 00000100:00100000:2.0:1783349985.340658:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340667:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340674:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340691:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340697:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340702:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340708:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340716:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340722:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340727:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340733:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340739:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340745:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340764:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340770:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340776:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340782:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340789:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340795:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340801:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340807:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340813:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340818:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340823:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340828:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340834:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340840:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340846:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340851:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340857:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340862:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340867:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340872:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340877:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340882:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340888:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340893:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340898:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340923:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340928:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340934:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340939:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340944:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340951:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340957:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340962:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340968:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340974:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340979:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340984:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340989:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340994:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.340999:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341005:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341010:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341015:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341020:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341026:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341031:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341036:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341041:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341047:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341052:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.341058:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783349985.342762:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349985.342774:0:15702:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1783349985.342780:0:15702:0:(genops.c:906:class_export_put()) final put ffff8ea243527000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1783349985.342784:0:15702:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea243527000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1783349985.342797:0:15702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1783349985.342853:0:15702:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea36d976000 1 00000020:00000080:2.0:1783349985.342859:0:15702:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd05e6ae1590e1eee 00000020:00000080:2.0:1783349985.342865:0:15702:0:(genops.c:906:class_export_put()) final put ffff8ea37f4e0000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1783349985.342894:0:15702:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1783349985.342899:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783349985.342913:0:15702:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783349985.342917:0:15702:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff8ea242448000) has no exports 00000020:00000080:1.0:1783349985.343371:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea37f4e0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783349985.414801:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349985.414815:0:15702:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1783349985.414821:0:15702:0:(genops.c:906:class_export_put()) final put ffff8ea36d975000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1783349985.414825:0:15702:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d975000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783349985.414835:0:15702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1783349985.415189:0:15702:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ea36d977000 00000020:01000000:2.0:1783349985.415209:0:15702:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1783349985.415213:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783349985.415217:0:15702:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783349985.415221:0:15702:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8ea370df8000) has no exports 00000020:00000080:2.0:1783349985.415245:0:15702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349985.415250:0:15702:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1783349985.415252:0:15702:0:(genops.c:906:class_export_put()) final put ffff8ea36d8f9000/OSS_uuid 00000020:00000080:2.0:1783349985.415255:0:15702:0:(genops.c:865:class_export_destroy()) destroying export ffff8ea36d8f9000/OSS_uuid for OSS 00000020:01000000:2.0:1783349985.415258:0:15702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1783349985.415329:0:9981:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ea243768000:9981] 3 exiting: rc = 0 00000100:00100000:2.0:1783349985.415406:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8ea36d950000:8431] 0 exiting: rc = 1 00000100:00100000:2.0:1783349985.415457:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8ea36ddb8c00:8432] 1 exiting: rc = 0 00000100:00080000:0.0:1783349985.416152:0:6513:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1783349985.416304:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8ea36ddb8e00:8433] 2 exiting: rc = 0 00000100:00100000:2.0:1783349985.416821:0:13811:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8ea243776e00:13811] 4 exiting: rc = 0 00000100:00100000:0.0:1783349985.417031:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417040:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417046:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417053:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417058:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417064:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417068:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417073:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417079:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417083:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417088:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417093:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417098:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417103:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417107:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417125:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417130:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417225:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417232:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417237:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417243:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.417247:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419067:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419083:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419089:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419094:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419099:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419103:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419325:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419330:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419336:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419341:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419346:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419350:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419356:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419360:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419364:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419369:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419374:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419379:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419383:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419387:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419392:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419397:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419402:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419406:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419411:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419416:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419421:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419426:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419447:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419452:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419457:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419462:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419467:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419472:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419477:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419483:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419489:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419493:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419498:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419503:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419509:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.419514:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349985.425538:0:11780:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8ea36daa7400:11780] 2 exiting: rc = 0 00000100:00100000:2.0:1783349985.426432:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8ea36d833000:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1783349985.427262:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8ea36d832600:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1783349985.427531:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427540:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427546:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427550:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427555:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427560:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427565:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427570:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427574:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427592:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427597:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427602:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427607:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427612:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427617:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427622:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427627:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427632:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427637:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427642:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427647:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427652:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427657:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427663:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427668:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427672:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427677:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427682:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427688:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427693:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427698:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427702:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427707:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427712:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427717:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427723:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427727:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427732:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427737:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427742:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427747:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427751:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427757:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427761:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427773:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427797:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.427993:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428002:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428007:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428012:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428017:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428022:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428027:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428032:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428036:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428041:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428046:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428051:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428056:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428061:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428066:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428071:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428076:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.428080:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349985.431723:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8ea36dff6600:8438] 1 exiting: rc = 0 00000100:00100000:1.0:1783349985.431943:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8ea375dfbc00:8439] 2 exiting: rc = 0 00000100:00100000:2.0:1783349985.432510:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8ea36dff7c00:8437] 0 exiting: rc = 1 00000100:00100000:3.0:1783349985.432672:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432681:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432687:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432692:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432699:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432703:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432709:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432713:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432718:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432724:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432728:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432734:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432740:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432746:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432750:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432755:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432760:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432766:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432770:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432791:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432806:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432812:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432817:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432821:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432826:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432832:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432837:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432842:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432847:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432852:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432933:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432942:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432949:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432956:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432961:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432967:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432973:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432978:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432984:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432991:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.432999:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433008:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433014:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433021:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433051:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433058:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433063:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433068:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433247:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433253:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433258:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433263:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433269:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433274:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433291:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433297:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433308:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433314:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433326:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433333:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433338:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433343:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433348:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.433353:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349985.446658:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8ea375dfb600:8441] 1 exiting: rc = 0 00000100:00100000:1.0:1783349985.446660:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8ea375dfb800:8440] 0 exiting: rc = 1 00000100:00100000:2.0:1783349985.446752:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446759:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446764:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446769:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446774:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446779:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446784:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446789:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446794:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446799:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446817:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446822:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446826:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446831:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446851:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446866:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446871:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446876:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446880:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446884:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446888:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446893:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446897:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446914:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446920:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446925:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446929:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446934:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446938:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446942:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446947:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446952:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446956:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446960:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446965:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446970:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446974:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446978:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446983:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446987:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446991:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.446996:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447001:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447005:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447009:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447014:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447019:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447023:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447028:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447040:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447045:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447050:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447055:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447059:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447064:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447069:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447074:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447079:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447084:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447089:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447094:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447099:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447104:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349985.447116:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457011:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8ea36d910c00:8443] 1 exiting: rc = 0 00000100:00100000:0.0:1783349985.457216:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8ea36d911600:8442] 0 exiting: rc = 1 00000100:00100000:3.0:1783349985.457284:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457293:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457301:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457307:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457312:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457318:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457344:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457353:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457359:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457366:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457373:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457396:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457404:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457409:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457415:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457421:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457426:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457432:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457453:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457459:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457465:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457471:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457477:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457483:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457508:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457513:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457519:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457524:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457529:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457546:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457567:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457574:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457580:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457587:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457593:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457599:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457604:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457609:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457799:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457811:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457818:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457824:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457847:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457855:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457861:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457867:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457876:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457882:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457890:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457895:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457911:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457918:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457924:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457930:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457951:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457959:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457965:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457972:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457978:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457991:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.457998:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.458004:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.458010:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783349985.458024:0:15702:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1783349985.480575:0:15702:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1783350005.536260:0:16467:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783350016.468743:0:17066:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783350016.468759:0:17066:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783350016.468760:0:17066:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783350016.474250:0:17066:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ea37f5b5800 00000020:01000004:0.0:1783350016.474277:0:17066:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783350016.474287:0:17066:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783350016.474302:0:17066:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ea36d140000) 00000020:00000080:0.0:1783350016.474315:0:17066:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783350016.578981:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783350016.586427:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783350016.588068:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783350016.589486:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783350016.589712:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783350016.593534:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783350016.597597:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783350016.598171:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783350016.598721:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783350016.600251:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783350016.600554:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783350016.601467:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783350016.605815:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783350016.607205:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783350016.614059:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1783350016.623108:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.624498:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.625595:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.629683:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.630354:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.630626:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.631122:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.632742:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.633509:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.634438:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.635090:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.635993:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.636317:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.636632:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.637158:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.638166:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.638639:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.639047:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.639290:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.639522:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.639988:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.640245:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.640429:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.640598:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.641010:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.642065:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.642761:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.643292:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.643490:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.644370:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.645078:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783350016.646296:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783350016.649703:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1783350016.651465:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1783350016.651784:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1783350016.652525:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1783350016.652980:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1783350016.653268:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1783350016.661770:0:17066:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783350016.662023:0:17066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783350016.662030:0:17066:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783350016.662041:0:17066:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e3139 00000020:01000004:2.0:1783350016.662047:0:17066:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783350016.662052:0:17066:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783350016.662057:0:17066:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea37f5b5800 from MGS 00000020:01000004:2.0:1783350016.662060:0:17066:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783350016.662081:0:17066:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ea24351cd40) 00000020:00000080:2.0:1783350016.662090:0:17066:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783350016.662455:0:17066:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea37f5b5800 from MGS, refs=2 00080000:01000000:2.0:1783350016.662461:0:17066:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783350016.662468:0:17066:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e3147 00000100:00100000:2.0:1783350016.662562:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783350016.663031:0:17066:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783350016.663038:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783350016.665551:0:17066:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783350016.665563:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783350016.667448:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783350016.667600:0:17066:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783350016.667605:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783350016.674473:0:17066:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783350016.674486:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783350016.679474:0:17066:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783350016.679485:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783350016.680674:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350016.680679:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350016.680680:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350016.681273:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350016.681276:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350016.681277:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350016.681816:0:17066:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783350016.695204:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1783350016.697763:0:17066:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783350016.702379:0:17078:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783350016.702511:0:17066:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783350016.702565:0:17066:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783350016.703616:0:17066:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783350016.712974:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783350016.713570:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783350016.713578:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783350016.739787:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783350016.740294:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783350016.753245:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783350016.753262:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783350016.770859:0:17066:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783350016.770883:0:17066:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.150@tcp' 00000020:01000004:2.0:1783350016.770885:0:17066:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783350016.770913:0:17066:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.150@tcp (typ=mgc) 00000020:00000080:2.0:1783350016.770926:0:17066:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.150@tcp (ffff8ea243518000) 00000020:00000080:2.0:1783350016.770941:0:17066:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783350016.771017:0:17066:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea3461c6000@MGC192.168.203.150@tcp: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1783350016.771206:0:17066:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.150@tcp-0 is initialized 00000040:01000000:2.0:1783350016.771212:0:17066:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 1 is initialized 10000000:01000000:2.0:1783350016.774133:0:17084:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783350016.774199:0:17066:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.150@tcp (uuid 7ee7701a-0ad8-4622-a3a4-e9603bf4c749) 00000020:00000080:2.0:1783350016.774220:0:17066:0:(genops.c:1406:class_connect()) connect: client 7ee7701a-0ad8-4622-a3a4-e9603bf4c749, cookie 0xd05e6ae1590e3155 00000100:00080000:2.0:1783350016.774232:0:17066:0:(import.c:512:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783350016.774238:0:17066:0:(import.c:626:import_select_connection()) MGC192.168.203.150@tcp: import ffff8ea3461c6000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350016.774268:0:17066:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243081c00 x1869977659537920/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783350016.774301:0:17066:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 7ee7701a-0ad8-4622-a3a4-e9603bf4c749->MGS 00000020:01000004:2.0:1783350016.774323:0:17066:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783350016.774335:0:17066:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783350016.774346:0:17066:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8ea2435199c0) 00000020:00000080:2.0:1783350016.774358:0:17066:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1783350016.775822:0:17083:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1783350016.793105:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3645:1869977659537920:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783350016.793208:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350016.799259:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659537920 00000100:00100000:1.0:1783350016.799274:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659537920 00000100:00100000:1.0:1783350016.799314:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783350016.799322:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1869977659537920:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1783350016.799347:0:17079:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7ee7701a-0ad8-4622-a3a4-e9603bf4c749@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:1.0:1783350016.799376:0:17079:0:(genops.c:1406:class_connect()) connect: client 7ee7701a-0ad8-4622-a3a4-e9603bf4c749, cookie 0xd05e6ae1590e3163 00000100:00080000:1.0:1783350016.799492:0:17079:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783350016.799572:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+5:3645:x1869977659537920:12345-0@lo:250:mount.lustre.0 Request processed in 250us (6363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350016.799580:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783350016.799595:0:3645:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783350016.799603:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.150@tcp: connect to target with instance 0 00000100:00080000:3.0:1783350016.799610:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783350016.799615:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783350016.799618:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea3461c6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783350016.799621:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783350016.799636:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783350016.799643:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3645:1869977659537920:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783350016.800859:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783350016.801007:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783350016.801013:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783350016.819576:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783350016.819589:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783350016.820115:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783350016.820124:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783350016.822124:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783350016.823053:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783350016.823060:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783350016.824579:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783350016.824588:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783350016.920399:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783350016.925008:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783350016.925020:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783350016.927275:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1783350016.927287:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783350016.927924:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783350016.928076:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783350016.928081:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783350016.929286:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783350016.929298:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783350016.934009:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783350016.934225:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783350016.934232:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783350016.938270:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783350016.938283:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783350016.941359:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783350016.941510:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783350016.941517:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783350016.946121:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783350016.946133:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1783350017.001111:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783350017.001353:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783350017.001359:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783350017.003002:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783350017.003014:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1783350017.008439:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783350017.008453:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783350017.009531:0:17066:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783350017.009555:0:17066:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783350017.009561:0:17066:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783350017.009730:0:17066:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783350017.009761:0:17066:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.150@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783350017.009764:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783350017.009766:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783350017.009767:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350017.009768:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350017.009770:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350017.009771:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350017.009772:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783350017.009774:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783350017.009775:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350017.009776:0:17066:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783350017.009779:0:17066:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783350017.009780:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783350017.009781:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783350017.009782:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350017.009783:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350017.009784:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350017.009785:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350017.009786:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783350017.009787:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783350017.009788:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350017.009789:0:17066:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783350017.009822:0:17066:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783350017.009840:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538048:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783350017.010063:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350017.010197:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea343bc29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350017.010511:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659538048 00000100:00100000:0.0:1783350017.010520:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659538048 00000100:00100000:0.0:1783350017.010562:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350017.010571:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+5:17066:x1869977659538048:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783350017.010621:0:17082:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783350017.010624:0:17082:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783350017.010627:0:17082:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1783350017.025360:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783350017.035809:0:17082:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1783350017.038844:0:17104:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783350017.038853:0:17104:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783350017.038855:0:17104:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783350017.038858:0:17104:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783350017.039268:0:17104:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1783350017.040025:0:17082:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783350017.040035:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783350017.054219:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+5:17066:x1869977659538048:12345-0@lo:253:mount.lustre.0 Request processed in 43639us (44146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350017.054233:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350017.054421:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538048:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783350017.054436:0:17066:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783350017.054440:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783350017.054441:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783350017.054442:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350017.054444:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350017.054445:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350017.054446:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350017.054448:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783350017.054449:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783350017.054451:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350017.054452:0:17066:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783350017.054473:0:17066:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea37f5b5800 from lustre-MDT0000 10000000:01000000:0.0:1783350017.054506:0:17066:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783350017.054517:0:17066:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783350017.054521:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ea243518000 10000000:01000000:0.0:1783350017.054525:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783350017.054532:0:17066:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ea243518000 from 1 10000000:01000000:0.0:1783350017.054535:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783350017.054571:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.054583:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.054593:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350017.054612:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350017.054658:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.054711:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b180 going to sleep for 11 seconds 00000100:00100000:1.0:1783350017.054886:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659538176 00000100:00100000:1.0:1783350017.054893:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659538176 00000100:00100000:1.0:1783350017.054939:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783350017.054948:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+5:17066:x1869977659538176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350017.054961:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350017.054975:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8c600/0xd05e6ae1590e3171 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e316a expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.054997:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8c600/0xd05e6ae1590e3171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e316a expref: 6 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.055007:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8c600/0xd05e6ae1590e3171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e316a expref: 6 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.055015:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c600, rc 0) 00000100:00100000:1.0:1783350017.055052:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+6:17066:x1869977659538176:12345-0@lo:101:mount.lustre.0 Request processed in 106us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350017.055058:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783350017.055176:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350017.055189:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.055197:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350017.055260:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350017.055285:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.055313:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b180 going to sleep for 11 seconds 00000100:00100000:1.0:1783350017.055528:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659538304 00000100:00100000:1.0:1783350017.055533:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659538304 00000100:00100000:1.0:1783350017.055566:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783350017.055573:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34460b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+6:17066:x1869977659538304:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350017.055658:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34460b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+6:17066:x1869977659538304:12345-0@lo:501:mount.lustre.0 Request processed in 86us (372us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783350017.055674:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783350017.055835:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538304:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783350017.055859:0:17066:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783350017.055892:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.055900:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350017.055907:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea37f5b5800 10000000:01000000:0.0:1783350017.055911:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783350017.055915:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ea37f5b5800 10000000:01000000:0.0:1783350017.055918:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783350017.055920:0:17066:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8ea37f5b5800 from 1 10000000:01000000:0.0:1783350017.055923:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783350017.055942:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.055949:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.055956:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350017.055969:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350017.055995:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.056766:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350017.067179:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659538432 00000100:00100000:2.0:1783350017.067193:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659538432 00000100:00100000:2.0:1783350017.067249:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783350017.067258:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea344608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+6:17066:x1869977659538432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350017.067275:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350017.067295:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c7600/0xd05e6ae1590e317f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3178 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.067322:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c7600/0xd05e6ae1590e317f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3178 expref: 7 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.067332:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c7600/0xd05e6ae1590e317f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3178 expref: 7 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.067357:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7600, rc 0) 00000100:00100000:2.0:1783350017.067424:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea344608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+7:17066:x1869977659538432:12345-0@lo:101:mount.lustre.0 Request processed in 167us (11428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350017.067431:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783350017.069065:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350017.069089:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.069100:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350017.069133:0:17066:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783350017.069179:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.069186:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364a000/0xd05e6ae1590e3178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e317f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350017.069193:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783350017.069198:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783350017.069205:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ea37f5b5800 10000000:01000000:0.0:1783350017.069208:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783350017.069211:0:17066:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783350017.069213:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783350017.069238:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.069245:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.069252:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350017.069269:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350017.069316:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.069348:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350017.070435:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659538560 00000100:00100000:2.0:1783350017.070445:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659538560 00000100:00100000:2.0:1783350017.070504:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350017.070513:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+7:17066:x1869977659538560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350017.070526:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350017.070541:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c6800/0xd05e6ae1590e318d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3186 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.070564:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c6800/0xd05e6ae1590e318d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3186 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.070575:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c6800/0xd05e6ae1590e318d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3186 expref: 8 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.070584:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6800, rc 0) 00000100:00100000:2.0:1783350017.070630:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+8:17066:x1869977659538560:12345-0@lo:101:mount.lustre.0 Request processed in 118us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350017.070636:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783350017.072276:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350017.072299:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.072324:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350017.072405:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350017.072456:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.072497:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b180 going to sleep for 11 seconds 00000100:00100000:1.0:1783350017.072562:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659538688 00000100:00100000:1.0:1783350017.072569:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659538688 00000100:00100000:1.0:1783350017.072613:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783350017.072622:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+8:17066:x1869977659538688:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350017.072788:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+9:17066:x1869977659538688:12345-0@lo:501:mount.lustre.0 Request processed in 165us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350017.072806:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783350017.073396:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350017.073433:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350017.073480:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.073501:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b180 going to sleep for 11 seconds 00000100:00100000:1.0:1783350017.073743:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659538816 00000100:00100000:1.0:1783350017.073750:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659538816 00000100:00100000:1.0:1783350017.073792:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783350017.073811:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+9:17066:x1869977659538816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350017.074865:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+9:17066:x1869977659538816:12345-0@lo:503:mount.lustre.0 Request processed in 1061us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350017.074874:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350017.075063:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659538816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350017.075422:0:17105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17105:1869977659538944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783350017.075469:0:17105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.075504:0:17105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b840 going to sleep for 11 seconds 00000100:00100000:2.0:1783350017.075544:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659538944 00000100:00100000:2.0:1783350017.075550:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659538944 00000100:00100000:2.0:1783350017.075589:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783350017.075598:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+10:17105:x1869977659538944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350017.077979:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+9:17105:x1869977659538944:12345-0@lo:502:llog_process_th.0 Request processed in 2282us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350017.077998:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783350017.078387:0:17105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17105:1869977659538944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783350017.078420:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350017.078431:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.078433:0:17105:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783350017.078438:0:17105:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783350017.078441:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783350017.078453:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ea36d1419c0) 00000020:00000080:0.0:1783350017.078468:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783350017.078472:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783350017.078540:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783350017.078546:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e319b 00000020:00000080:0.0:1783350017.079447:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783350017.079453:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350017.079458:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.079460:0:17105:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783350017.079463:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350017.079467:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.079468:0:17105:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783350017.079471:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783350017.079480:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ea36d143380) 00000020:00000080:0.0:1783350017.079492:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783350017.079496:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783350017.079498:0:17105:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783350017.079501:0:17105:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783350017.079506:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783350017.079555:0:17105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea37f5b5800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783350017.079568:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ea36d144d40) 00000020:00000080:0.0:1783350017.079575:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783350017.079634:0:17105:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783350017.079640:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e31b0 00000020:00000080:1.0:1783350017.098180:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783350017.098196:0:17105:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783350017.098208:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd05e6ae1590e31b7 00080000:01000000:1.0:1783350017.098218:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783350017.098223:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e31be 00010000:00010000:2.0:1783350017.337333:0:17105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783350017.338417:0:17105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1783350017.339021:0:17105:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783350017.339487:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ea24351b380) 00000020:00000080:2.0:1783350017.339510:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783350017.339590:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783350017.339603:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e31cc 00000020:00000080:2.0:1783350017.348213:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783350017.366013:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd05e6ae1590e31d3 00000020:00000080:3.0:1783350017.370788:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783350017.370810:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350017.370817:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350017.370831:0:17105:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783350017.370836:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783350017.370838:0:17105:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1783350017.370840:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783350017.370842:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783350017.370843:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783350017.370845:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350017.370847:0:17105:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783350017.370849:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783350017.370854:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350017.370856:0:17105:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783350017.370860:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783350017.371074:0:17105:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783350017.371096:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350017.371100:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350017.371102:0:17105:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783350017.371104:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783350017.371107:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350017.371108:0:17105:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783350017.371111:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783350017.371118:0:17105:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:00000080:3.0:1783350017.371170:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783350017.371236:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ea37f45cd40) 00000020:00000080:3.0:1783350017.371251:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1783350017.371257:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783350017.371307:0:17105:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783350017.371312:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783350017.371318:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e31e1 00010000:00080000:3.0:1783350017.371346:0:17105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea345adf000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783350017.379113:0:17105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1783350017.390311:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783350017.390325:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783350017.390363:0:17105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783350017.390392:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e31e8 00000100:00080000:3.0:1783350017.390401:0:17105:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783350017.390406:0:17105:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea345adf000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350017.390438:0:17105:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36cf4df80 x1869977659539072/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783350017.390461:0:17105:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783350017.390518:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350017.390522:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350017.390524:0:17105:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783350017.390527:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783350017.390529:0:17105:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1783350017.390531:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783350017.390532:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783350017.390534:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783350017.390536:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350017.390537:0:17105:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783350017.390539:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783350017.390543:0:17105:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783350017.390546:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350017.390547:0:17105:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783350017.390549:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783350017.390553:0:17105:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:3.0:1783350017.390572:0:17105:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783350017.390574:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783350017.390585:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ea37f4599c0) 00000020:00000080:3.0:1783350017.390595:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1783350017.390599:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1783350017.390775:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659539072:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783350017.390845:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783350017.391162:0:17105:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783350017.391168:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783350017.391175:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e31f6 00010000:00080000:3.0:1783350017.391201:0:17105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea243259000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783350017.391406:0:17105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1783350017.391991:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659539072 00000100:00100000:0.0:1783350017.391999:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659539072 00000100:00100000:0.0:1783350017.392026:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783350017.392033:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869977659539072:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1783350017.392047:0:17092:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783350017.394476:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659539200:0@lo:400:kworker.0 00000100:00100000:2.0:1783350017.394542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1783350017.397183:0:17105:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783350017.397995:0:17105:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1783350017.398582:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659539200 00000100:00100000:1.0:1783350017.398592:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659539200 00000100:00100000:1.0:1783350017.398695:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350017.398705:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+9:3647:x1869977659539200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350017.398803:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+9:3647:x1869977659539200:12345-0@lo:400:kworker.0 Request processed in 90us (4250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350017.398810:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:00080000:3.0:1783350017.408296:0:17105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783350017.408484:0:17105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:2.0:1783350017.412619:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659539200:0@lo:400:kworker.0 00000040:00080000:3.0:1783350017.421505:0:17105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1783350017.430378:0:17111:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783350017.430388:0:17111:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1783350017.437697:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869977659539072:12345-0@lo:38:llog_process_th.0 Request processed in 45656us (46844us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783350017.437711:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783350017.438055:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350017.438061:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783350017.438066:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659539072:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1783350017.439072:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783350017.439087:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783350017.439577:0:17105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783350017.439596:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e31fd 00000100:00080000:0.0:1783350017.439613:0:17105:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783350017.439617:0:17105:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ea243259000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350017.439744:0:17105:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243bace00 x1869977659539328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350017.439800:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659539328:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783350017.439857:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659539328 offset 0 length 520: 4 00000100:00080000:0.0:1783350017.440049:0:17105:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783350017.440299:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350017.440305:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.440306:0:17105:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783350017.440310:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783350017.440312:0:17105:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1783350017.440314:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783350017.440315:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783350017.440317:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783350017.440319:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.440320:0:17105:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783350017.440322:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783350017.440326:0:17105:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783350017.440329:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.440330:0:17105:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783350017.440333:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783350017.440336:0:17105:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:0.0:1783350017.440353:0:17105:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783350017.440355:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783350017.440367:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ea349e33380) 00000020:00000080:0.0:1783350017.440380:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1783350017.440384:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783350017.440444:0:17105:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783350017.440450:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1783350017.440454:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd05e6ae1590e320b 00010000:00080000:0.0:1783350017.440482:0:17105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea36d970000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:0.0:1783350017.440703:0:17105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1783350017.440778:0:17105:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783350017.440802:0:17105:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783350017.448320:0:17105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783350017.449012:0:17105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1783350017.449195:0:17105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1783350017.458535:0:17113:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783350017.458545:0:17113:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783350017.469818:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783350017.469831:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783350017.469869:0:17105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783350017.470013:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e3212 00000100:00080000:0.0:1783350017.470024:0:17105:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783350017.470029:0:17105:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ea36d970000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350017.470076:0:17105:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243bad500 x1869977659539456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783350017.470105:0:17105:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1783350017.470237:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659539456:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783350017.470290:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659539456 offset 0 length 520: 4 00000020:01000000:0.0:1783350017.470532:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350017.470536:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.470538:0:17105:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783350017.470541:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350017.470545:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.470546:0:17105:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783350017.470549:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783350017.470550:0:17105:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783350017.470553:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350017.470555:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.470556:0:17105:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783350017.470558:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350017.470560:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.470562:0:17105:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783350017.470565:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783350017.470591:0:17105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17105:1869977659539584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783350017.470649:0:17105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.470673:0:17105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783350017.472437:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659539584 00000100:00100000:3.0:1783350017.472449:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659539584 00000100:00100000:3.0:1783350017.472501:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783350017.472510:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+9:17105:x1869977659539584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783350017.473057:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+9:17105:x1869977659539584:12345-0@lo:502:llog_process_th.0 Request processed in 545us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350017.473064:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783350017.473323:0:17105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17105:1869977659539584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783350017.473354:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350017.473361:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350017.473363:0:17105:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783350017.473367:0:17105:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1783350017.473740:0:17066:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1783350017.473760:0:17066:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783350017.473779:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350017.473811:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364b600/0xd05e6ae1590e3186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e318d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350017.473819:0:17066:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea37f5b5800 from 1 10000000:01000000:3.0:1783350017.473822:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783350017.473854:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350017.473863:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350017.473871:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350017.474332:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659539712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350017.474381:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350017.474414:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea359362000 going to sleep for 11 seconds 00000100:00100000:0.0:1783350017.474507:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659539712 00000100:00100000:0.0:1783350017.474514:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659539712 00000100:00100000:0.0:1783350017.474551:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350017.474559:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+9:17066:x1869977659539712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350017.474571:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350017.474587:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea24364a600/0xd05e6ae1590e3220 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3219 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.474609:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea24364a600/0xd05e6ae1590e3220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3219 expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.474620:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea24364a600/0xd05e6ae1590e3220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3219 expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.474628:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a600, rc 0) 00000100:00100000:0.0:1783350017.474755:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+10:17066:x1869977659539712:12345-0@lo:101:mount.lustre.0 Request processed in 196us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350017.474762:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350017.480438:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659539712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350017.480464:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.480497:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350017.481579:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659539840:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783350017.481868:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.482007:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783350017.482030:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659539840 00000100:00100000:0.0:1783350017.482036:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659539840 00000100:00100000:0.0:1783350017.482168:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783350017.482306:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+10:17066:x1869977659539840:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783350017.482332:0:17079:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783350017.482337:0:17079:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783350017.482409:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+10:17066:x1869977659539840:12345-0@lo:256:mount.lustre.0 Request processed in 232us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350017.482417:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783350017.482551:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659539840:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783350017.487212:0:17066:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783350017.487248:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350017.487260:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350017.487269:0:17066:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea37f5b5800 from 1 10000000:01000000:3.0:1783350017.487272:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783350017.487366:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350017.487375:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350017.487385:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350017.487409:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659539968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350017.487473:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350017.492302:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3593626c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350017.496746:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659539968 00000100:00100000:2.0:1783350017.496760:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659539968 00000100:00100000:3.0:1783350017.496935:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783350017.496946:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+10:17066:x1869977659539968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350017.496963:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350017.496986:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea340031c00/0xd05e6ae1590e322e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3227 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350017.497013:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea340031c00/0xd05e6ae1590e322e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3227 expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350017.497024:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea340031c00/0xd05e6ae1590e322e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3227 expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350017.497034:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031c00, rc 0) 00000100:00100000:3.0:1783350017.497107:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17066:x1869977659539968:12345-0@lo:101:mount.lustre.0 Request processed in 163us (9633us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350017.497115:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783350017.497188:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659539968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350017.497219:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350017.497230:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350017.497317:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659540096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350017.497351:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350017.497380:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3593626c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350017.497393:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659540096 00000100:00100000:3.0:1783350017.497397:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659540096 00000100:00100000:3.0:1783350017.497415:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783350017.497420:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17066:x1869977659540096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350017.497536:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17066:x1869977659540096:12345-0@lo:501:mount.lustre.0 Request processed in 115us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350017.497544:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783350017.497575:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659540096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350017.497601:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659540224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783350017.497652:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350017.497674:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351b09e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783350017.497686:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659540224 00000100:00100000:3.0:1783350017.497690:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659540224 00000100:00100000:3.0:1783350017.497706:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783350017.497712:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17066:x1869977659540224:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783350017.497786:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17066:x1869977659540224:12345-0@lo:503:mount.lustre.0 Request processed in 73us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350017.497812:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783350017.497852:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659540224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350017.505059:0:17115:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17115:1869977659540352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350017.505159:0:17115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350017.505197:0:17115:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1783350017.505250:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659540352 00000100:00100000:3.0:1783350017.505257:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659540352 00000100:00100000:3.0:1783350017.505295:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783350017.505303:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17115:x1869977659540352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783350017.505696:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17115:x1869977659540352:12345-0@lo:502:llog_process_th.0 Request processed in 392us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350017.505704:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783350017.506060:0:17115:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17115:1869977659540352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783350017.506086:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350017.506094:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350017.506096:0:17115:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783350017.506103:0:17115:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea37f5b5800 00000020:00000080:2.0:1783350017.506106:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783350017.506119:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350017.506121:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350017.506123:0:17115:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783350017.506125:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350017.506128:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350017.506129:0:17115:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783350017.506133:0:17115:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea37f5b5800 00000020:00000080:2.0:1783350017.506161:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783350017.506205:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350017.506208:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350017.506209:0:17115:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783350017.506211:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350017.506214:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350017.506215:0:17115:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783350017.506218:0:17115:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea37f5b5800 00000020:00000080:2.0:1783350017.506220:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783350017.506234:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350017.506236:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350017.506238:0:17115:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783350017.506240:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350017.506242:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350017.506243:0:17115:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783350017.506246:0:17115:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea37f5b5800 00000020:00000080:2.0:1783350017.506248:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783350017.506279:0:17115:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17115:1869977659540480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350017.506313:0:17115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350017.506338:0:17115:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783350017.506424:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659540480 00000100:00100000:0.0:1783350017.506430:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659540480 00000100:00100000:0.0:1783350017.506455:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783350017.506462:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17115:x1869977659540480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783350017.506534:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17115:x1869977659540480:12345-0@lo:502:llog_process_th.0 Request processed in 72us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350017.506540:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783350017.507830:0:17115:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17115:1869977659540480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783350017.507865:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350017.507872:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350017.507874:0:17115:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783350017.508031:0:17115:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783350017.508436:0:17066:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783350017.508460:0:17066:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783350017.508484:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.508506:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350017.508557:0:17066:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783350017.508560:0:17066:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea37f5b5800 10000000:01000000:0.0:1783350017.508563:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea37f5b5800 10000000:01000000:0.0:1783350017.508566:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783350017.508571:0:17066:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea37f5b5800 from 1 10000000:01000000:0.0:1783350017.508574:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783350017.508604:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.508613:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.508622:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350017.508651:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659540608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350017.508712:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.508741:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783350017.508758:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659540608 00000100:00100000:0.0:1783350017.508763:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659540608 00000100:00100000:0.0:1783350017.509010:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783350017.509019:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17066:x1869977659540608:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350017.509031:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350017.509042:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea24364ac00/0xd05e6ae1590e323c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3235 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.509075:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea24364ac00/0xd05e6ae1590e323c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3235 expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.509085:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea24364ac00/0xd05e6ae1590e323c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3235 expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.509094:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364ac00, rc 0) 00000100:00100000:0.0:1783350017.509132:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17066:x1869977659540608:12345-0@lo:101:mount.lustre.0 Request processed in 114us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350017.509168:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783350017.509206:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659540608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350017.509217:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.509226:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350017.509272:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659540736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350017.509294:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.509309:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783350017.509322:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659540736 00000100:00100000:0.0:1783350017.509325:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659540736 00000100:00100000:0.0:1783350017.509340:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783350017.509345:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17066:x1869977659540736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350017.509440:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17066:x1869977659540736:12345-0@lo:501:mount.lustre.0 Request processed in 94us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350017.509458:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783350017.509485:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659540736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350017.509510:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659540864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350017.509544:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350017.509555:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24350b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783350017.509566:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659540864 00000100:00100000:0.0:1783350017.509569:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659540864 00000100:00100000:0.0:1783350017.509584:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783350017.509588:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17066:x1869977659540864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350017.509686:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17066:x1869977659540864:12345-0@lo:503:mount.lustre.0 Request processed in 97us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350017.509693:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783350017.509727:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659540864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350017.512500:0:17117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17117:1869977659540992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783350017.512576:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350017.512618:0:17117:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66300 going to sleep for 11 seconds 00000100:00100000:2.0:1783350017.512697:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659540992 00000100:00100000:2.0:1783350017.512704:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659540992 00000100:00100000:2.0:1783350017.512750:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783350017.512758:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17117:x1869977659540992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350017.513065:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17117:x1869977659540992:12345-0@lo:502:llog_process_th.0 Request processed in 306us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350017.513073:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783350017.513188:0:17117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17117:1869977659540992:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783350017.513251:0:17117:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783350017.513267:0:17117:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ea241dcb380) 00000020:00000080:1.0:1783350017.513283:0:17117:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1783350017.513434:0:17117:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea37f5b5800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783350017.513438:0:17117:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea37f5b5800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783350017.513441:0:17117:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea37f5b5800 4 00010000:00080000:1.0:1783350017.513467:0:17117:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea349fe8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783350017.524165:0:17117:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1783350017.524269:0:17117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783350017.524313:0:17117:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783350017.524327:0:17117:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd05e6ae1590e324a 00000100:00080000:1.0:1783350017.524338:0:17117:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783350017.524345:0:17117:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ea349fe8800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350017.524381:0:17117:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244527480 x1869977659541120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350017.524413:0:17117:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783350017.525253:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659541120:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783350017.525324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350017.526162:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659541120 00000100:00100000:1.0:1783350017.526173:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659541120 00000100:00100000:1.0:1783350017.526215:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783350017.526223:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869977659541120:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783350017.526284:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869977659541120:12345-0@lo:38:llog_process_th.0 Request processed in 60us (959us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783350017.526290:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783350017.527784:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783350017.527804:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350017.527810:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783350017.527814:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659541120:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783350017.528100:0:17117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17117:1869977659541248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350017.528185:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350017.528214:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659541248 00000100:00100000:2.0:1783350017.528220:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659541248 00000100:00100000:2.0:1783350017.528259:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783350017.528268:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17117:x1869977659541248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350017.528376:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17117:x1869977659541248:12345-0@lo:502:llog_process_th.0 Request processed in 108us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350017.528383:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783350017.528428:0:17117:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350017.528441:0:17117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17117:1869977659541248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350017.528478:0:17117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17117:1869977659541376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350017.528513:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350017.528536:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659541376 00000100:00100000:2.0:1783350017.528539:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659541376 00000100:00100000:2.0:1783350017.528559:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783350017.528566:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17117:x1869977659541376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783350017.528620:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17117:x1869977659541376:12345-0@lo:502:llog_process_th.0 Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350017.528626:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783350017.529317:0:17117:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350017.529334:0:17117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17117:1869977659541376:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783350017.529358:0:17117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783350017.529420:0:17066:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783350017.529445:0:17066:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783350017.529460:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.529469:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364aa00/0xd05e6ae1590e3235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e323c expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783350017.529513:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783350017.529516:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783350017.529517:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350017.529518:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350017.529519:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350017.529521:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350017.529522:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350017.529524:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783350017.529525:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350017.529527:0:17066:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783350017.529530:0:17066:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783350017.529538:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783350017.529539:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783350017.529540:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350017.529541:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350017.529542:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350017.529543:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350017.529544:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350017.529544:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783350017.529545:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350017.529546:0:17066:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783350017.529561:0:17066:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783350017.529574:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659541504:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783350017.529610:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350017.529624:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350017.534457:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659541504 00000100:00100000:2.0:1783350017.534472:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659541504 00000100:00100000:2.0:1783350017.534529:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783350017.534539:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17066:x1869977659541504:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783350017.534576:0:17081:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783350017.534589:0:17081:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783350017.551464:0:17081:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783350017.551516:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783350017.555048:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17066:x1869977659541504:12345-0@lo:253:mount.lustre.0 Request processed in 20501us (25429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350017.555062:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783350017.555130:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17066:1869977659541504:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783350017.555160:0:17066:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783350017.555163:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783350017.555165:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783350017.555166:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350017.555167:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350017.555168:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350017.555189:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350017.555190:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350017.555192:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783350017.555193:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350017.555195:0:17066:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783350017.555210:0:17066:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1783350017.567998:0:17103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783350017.568009:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783350017.568032:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.568050:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea24364a600/0xd05e6ae1590e3220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3219 expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.568069:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.568110:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea24364a600/0xd05e6ae1590e3220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3219 expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.568125:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea24364a600/0xd05e6ae1590e3220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3219 expref: 11 pid: 17082 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350017.568154:0:17103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659541632:0@lo:104: 00000100:00100000:1.0:1783350017.568229:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350017.568275:0:17103:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783350017.571459:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659541632 00000100:00100000:0.0:1783350017.571474:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659541632 00000100:00100000:0.0:1783350017.571527:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783350017.571538:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:17103:x1869977659541632:12345-0@lo:104: 00010000:00010000:0.0:1783350017.571554:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.573106:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783350017.573121:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:17103:x1869977659541632:12345-0@lo:104: Request processed in 1583us (4889us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350017.573130:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783350017.573215:0:17103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659541632:0@lo:104: 00010000:00010000:0.0:1783350017.573247:0:17103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.574025:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350017.574033:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.574043:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350017.574047:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.574055:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350017.574062:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350017.574068:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783350017.574113:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.574129:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783350017.574181:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.574188:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340031800/0xd05e6ae1590e3219 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3220 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350017.574205:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350017.574207:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350017.574209:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350017.574249:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659541760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350017.574305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350017.576499:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659541760 00000100:00100000:2.0:1783350017.576512:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659541760 00010000:00010000:2.0:1783350017.576545:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea24364a600/0xd05e6ae1590e3220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3219 expref: 12 pid: 17082 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350017.576600:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783350017.576608:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:3648:x1869977659541760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783350017.576623:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350017.576628:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea24364a600/0xd05e6ae1590e3220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3219 expref: 12 pid: 17082 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576640:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea24364a600/0xd05e6ae1590e3220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3219 expref: 12 pid: 17082 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576667:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea24364a600/0xd05e6ae1590e3220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3219 expref: 12 pid: 17082 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576680:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576688:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783350017.576703:0:17072:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008695573s 00010000:00010000:2.0:1783350017.576708:0:17072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576728:0:17072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576735:0:17072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576741:0:17072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576747:0:17072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350017.576751:0:17072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576759:0:17072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576781:0:17072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350017.576801:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783350017.576857:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:3648:x1869977659541760:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350017.576865:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783350017.577318:0:17103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.577327:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350017.577332:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e3251 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350017.580509:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659541760:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1783350017.610802:0:17066:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1783350017.611323:0:17066:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783350017.611460:0:17126:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1783350017.611465:0:17126:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1783350017.614315:0:17127:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783350017.614770:0:17066:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1783350017.616531:0:17128:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8ea244526300 x1869977659541888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350017.616556:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00000040:00080000:2.0:1783350017.616716:0:17127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783350017.620735:0:17066:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783350017.620776:0:17066:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783350017.625006:0:17127:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783350017.625103:0:17127:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1783350017.625715:0:17066:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783350017.625730:0:17066:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783350017.625815:0:17066:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783350017.626774:0:17066:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783350017.627325:0:17066:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783350017.627355:0:17066:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1783350017.633861:0:17066:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1783350017.659465:0:17066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1783350017.667075:0:17066:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783350017.667111:0:17066:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9d9841537988 00100000:10000000:3.0:1783350017.667119:0:17066:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783350017.675440:0:17066:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783350017.675456:0:17066:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783350017.675470:0:17066:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783350017.675485:0:17066:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783350017.684579:0:17066:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783350017.692154:0:17066:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783350017.736904:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783350018.500225:0:17084:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783350018.500232:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea37f5b5800 from 7 10000000:01000000:1.0:1783350018.500237:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783350018.500280:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350018.500292:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350018.500320:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350018.500344:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659542016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783350018.500415:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350018.500458:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350018.500507:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659542016 00000100:00100000:2.0:1783350018.500521:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659542016 00000100:00100000:2.0:1783350018.500626:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783350018.500642:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+11:17084:x1869977659542016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350018.500663:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350018.500677:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e325f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3258 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350018.500699:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e325f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3258 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350018.500708:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e325f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3258 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350018.500716:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6c00, rc 0) 00000100:00100000:2.0:1783350018.500756:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17084:x1869977659542016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350018.500763:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783350018.501021:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659542016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350018.501035:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350018.501043:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350018.501104:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659542144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783350018.501160:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350018.501174:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350018.501227:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659542144 00000100:00100000:2.0:1783350018.501232:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659542144 00000100:00100000:2.0:1783350018.501264:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783350018.501272:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17084:x1869977659542144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783350018.501285:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783350018.501300:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783350018.501303:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1783350018.501379:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17084:x1869977659542144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350018.501394:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783350018.501891:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659542144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783350018.501945:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783350018.501953:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350018.501961:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350018.628249:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00000040:00080000:0.0:1783350018.628928:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783350018.764475:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783350019.654741:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783350019.657734:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:0.0:1783350019.790066:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350020.682716:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:1.0:1783350020.804347:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350021.702582:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:0.0:1783350021.830563:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783350022.485491:0:17372:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1783350022.534260:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783350022.534267:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783350022.534278:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350022.534286:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1783350022.534292:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783350022.534299:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea345adf000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350022.534322:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244526680 x1869977659542400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350022.534340:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350022.534343:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350022.534346:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350022.534349:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350022.534351:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783350022.534355:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783350022.534357:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350022.534361:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ea349fe8800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350022.534373:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244526d80 x1869977659542528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783350022.534406:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783350022.534423:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659542272:0@lo:400:kworker.0 00000100:00100000:1.0:1783350022.534490:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350022.534553:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659542400:0@lo:38:kworker.0 00000100:00100000:1.0:1783350022.534642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350022.534682:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659542528:0@lo:38:kworker.0 00000100:00100000:1.0:1783350022.534714:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350022.534745:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659542272 00000100:00100000:1.0:1783350022.534752:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659542272 00000100:00100000:1.0:1783350022.534793:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783350022.534802:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:3648:x1869977659542272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350022.534870:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:3648:x1869977659542272:12345-0@lo:400:kworker.0 Request processed in 61us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350022.534877:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783350022.534925:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659542272:0@lo:400:kworker.0 00000100:00100000:2.0:1783350022.536111:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659542400 00000100:00100000:2.0:1783350022.536121:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659542400 00000100:00100000:2.0:1783350022.536178:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783350022.536185:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659542400:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783350022.536201:0:17093:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783350022.538258:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659542528 00000100:00100000:3.0:1783350022.538271:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659542528 00000100:00100000:3.0:1783350022.538319:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783350022.538336:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659542528:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783350022.538374:0:17089:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:3.0:1783350022.538411:0:17089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd05e6ae1590e3266 00000004:00100000:3.0:1783350022.538436:0:17089:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783350022.538562:0:17089:0:(import.c:65:import_set_state_nolock()) ffff8ea36ccd8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783350022.538643:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869977659542528:12345-0@lo:38:kworker.0 Request processed in 307us (3927us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350022.538651:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783350022.538727:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea244526d80 x1869977659542528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783350022.538743:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783350022.538750:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783350022.538754:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783350022.538757:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783350022.538763:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869977659542528:0@lo:38:kworker.0 00000100:00100000:2.0:1783350022.556685:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659542400:12345-0@lo:38:kworker.0 Request processed in 20492us (22035us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783350022.556700:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783350022.558016:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783350022.558027:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783350022.558033:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659542400:0@lo:38:kworker.0 00000100:00100000:3.0:1783350022.725239:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:1.0:1783350022.852354:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783350023.422694:0:17424:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783350023.422855:0:17424:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783350023.748319:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:0.0:1783350023.879735:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783350024.426572:0:17474:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783350024.426905:0:17474:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783350024.772401:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:0.0:1783350024.905351:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350025.797992:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:0.0:1783350025.924382:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350026.820850:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:2.0:1783350026.950230:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350027.652927:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350017/real 1783350017] req@ffff8ea243bad500 x1869977659539456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783350027.652952:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:3.0:1783350027.652957:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea243bad500 x1869977659539456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350027 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783350027.652960:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783350027.652971:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783350027.652972:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350017/real 1783350017] req@ffff8ea243bace00 x1869977659539328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783350027.652981:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 463 00000100:00080000:1.0:1783350027.652988:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1783350027.652991:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea243bace00 x1869977659539328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350027 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783350027.652996:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea345adf000 using connection 192.168.203.150@tcp/0@lo 00000100:00080000:3.0:1783350027.653014:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d970000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783350027.653022:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244526d80 x1869977659542784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783350027.653029:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783350027.653037:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659539456:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783350027.653039:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350027.656447:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350027.656452:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350027.656457:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783350027.656460:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea36d970000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350027.656467:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1783350027.656473:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783350027.656482:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ea36d970000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350027.656521:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244527100 x1869977659542912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783350027.659207:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783350027.659224:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783350027.659230:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659539328:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783350027.659266:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659542784:0@lo:38:kworker.0 00000100:00100000:3.0:1783350027.659327:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350027.659668:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659542912:0@lo:8:kworker.0 00000100:00100000:2.0:1783350027.659676:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659542784 00000100:00100000:2.0:1783350027.659685:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659542784 00000400:00000100:3.0:1783350027.659689:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659542912 offset 0 length 520: 4 00000100:00100000:2.0:1783350027.659726:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783350027.659735:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869977659542784:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783350027.659754:0:17092:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1783350027.659956:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350027.659961:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783350027.659964:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350027.659969:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1783350027.659973:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783350027.659978:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ea243259000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350027.660005:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244525c00 x1869977659543168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783350027.660504:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659542656:0@lo:400:kworker.0 00000100:00100000:1.0:1783350027.660669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350027.660699:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350027.660705:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659543040:0@lo:400:kworker.0 00000100:00100000:1.0:1783350027.660733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350027.660780:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659542656 00000100:00100000:1.0:1783350027.660784:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659542656 00000100:00100000:1.0:1783350027.660841:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783350027.660848:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:3646:x1869977659542656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350027.660897:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:3646:x1869977659542656:12345-0@lo:400:kworker.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350027.660904:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783350027.660942:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659543040 00000100:00100000:1.0:1783350027.660946:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659543040 00000100:00100000:1.0:1783350027.660973:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783350027.660980:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659543040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350027.661010:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659543040:12345-0@lo:400:kworker.0 Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350027.661016:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783350027.661050:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea244526a00 x1869977659543040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350027.661064:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659543040:0@lo:400:kworker.0 00000100:00100000:1.0:1783350027.661075:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659542656:0@lo:400:kworker.0 00000100:00100000:1.0:1783350027.661100:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659543168:0@lo:8:kworker.0 00000400:00000100:1.0:1783350027.661133:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659543168 offset 0 length 520: 4 00000100:00100000:3.0:1783350027.686265:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869977659542784:12345-0@lo:38:kworker.0 Request processed in 26523us (26931us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783350027.686283:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1783350027.687064:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783350027.687128:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783350027.687133:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659542784:0@lo:38:kworker.0 00000100:00100000:3.0:1783350027.844245:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:1.0:1783350027.973154:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350028.870724:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:2.0:1783350028.997049:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350029.892288:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00000040:00080000:0.0:1783350029.893858:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783350030.021714:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350030.930414:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:2.0:1783350031.044561:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783350031.919305:0:17819:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783350031.919309:0:17819:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783350031.919311:0:17819:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783350031.919388:0:17819:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ea348c55800 00000020:01000004:1.0:1783350031.919400:0:17819:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1783350031.919411:0:17819:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783350031.919424:0:17819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8ea241dccd40) 00000020:00000080:1.0:1783350031.919438:0:17819:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:1.0:1783350031.940693:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00100000:10000000:1.0:1783350031.973000:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783350031.973479:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1783350031.974988:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1783350031.976891:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1783350031.977316:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783350031.977536:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1783350031.977710:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1783350031.977887:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1783350031.978044:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783350031.978730:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783350031.979270:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783350031.979531:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1783350031.979718:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1783350031.980055:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783350031.982540:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1783350031.983397:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783350031.984083:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1783350031.984524:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783350031.984900:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1783350031.985099:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783350031.985357:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783350031.985636:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1783350031.985813:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783350031.985972:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783350031.986252:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1783350031.986534:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783350031.986739:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783350031.986979:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1783350031.987227:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783350031.987616:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783350031.987928:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783350031.988642:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783350031.989729:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783350031.990061:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1783350031.990631:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783350031.990881:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1783350031.991069:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1783350031.991285:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783350031.991559:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783350031.991748:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1783350031.991961:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783350031.992301:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1783350031.992574:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783350031.992818:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783350031.993133:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783350031.993598:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00080000:01000000:3.0:1783350031.994761:0:17819:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783350032.000235:0:17819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1783350032.000247:0:17819:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783350032.000261:0:17819:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e3274 00000020:01000004:3.0:1783350032.000268:0:17819:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783350032.000286:0:17819:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783350032.000290:0:17819:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783350032.000296:0:17819:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1783350032.000325:0:17819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1783350032.000329:0:17819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1783350032.005596:0:17819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783350032.005665:0:17819:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.150@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1783350032.005670:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783350032.005671:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783350032.005673:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350032.005674:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350032.005675:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350032.005676:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350032.005677:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783350032.005679:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350032.005680:0:17819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783350032.005683:0:17819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1783350032.005685:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783350032.005686:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783350032.005687:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350032.005688:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350032.005689:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350032.005690:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350032.005691:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783350032.005692:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350032.005693:0:17819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783350032.005715:0:17819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783350032.005732:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783350032.005803:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350032.005899:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350032.006100:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659543296 00000100:00100000:1.0:1783350032.006107:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659543296 00000100:00100000:1.0:1783350032.006246:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783350032.006255:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17819:x1869977659543296:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783350032.006281:0:17081:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783350032.006290:0:17081:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1783350032.006296:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783350032.006680:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17819:x1869977659543296:12345-0@lo:253:mount.lustre.0 Request processed in 425us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350032.006688:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783350032.006747:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543296:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783350032.006755:0:17819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1783350032.006757:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783350032.006759:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783350032.006760:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350032.006761:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350032.006762:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350032.006771:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350032.006773:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783350032.006774:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350032.006775:0:17819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783350032.006789:0:17819:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea348c55800 from lustre-MDT0001 10000000:01000000:3.0:1783350032.006811:0:17819:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1783350032.006813:0:17819:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783350032.006819:0:17819:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ea243518000 local copy 00010000:00010000:3.0:1783350032.006827:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350032.006896:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350032.006921:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350032.007773:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.007810:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659543424 00000100:00100000:2.0:1783350032.007816:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659543424 00000100:00100000:2.0:1783350032.007859:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783350032.007867:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17819:x1869977659543424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350032.008065:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17819:x1869977659543424:12345-0@lo:501:mount.lustre.0 Request processed in 198us (1141us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783350032.008073:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783350032.008312:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543424:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783350032.008327:0:17819:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783350032.008346:0:17819:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783350032.008364:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.008373:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350032.008397:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea348c55800 10000000:01000000:3.0:1783350032.008406:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783350032.008411:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ea243518000 10000000:01000000:3.0:1783350032.008414:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783350032.008417:0:17819:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8ea243518000 from 1 10000000:01000000:3.0:1783350032.008420:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783350032.008446:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031400/0xd05e6ae1590e327b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.008454:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea340031400/0xd05e6ae1590e327b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.008463:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea340031400/0xd05e6ae1590e327b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350032.008479:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350032.008507:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350032.008535:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea349a5ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1783350032.008562:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659543552 00000100:00100000:0.0:1783350032.008567:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659543552 00000100:00100000:1.0:1783350032.008591:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783350032.008600:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+12:17819:x1869977659543552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350032.008609:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350032.008621:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e3282 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e327b expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350032.008639:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e3282 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e327b expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350032.008646:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8ce00/0xd05e6ae1590e3282 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e327b expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350032.008652:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8ce00, rc 0) 00000100:00100000:1.0:1783350032.008680:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+13:17819:x1869977659543552:12345-0@lo:101:mount.lustre.0 Request processed in 83us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350032.008687:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783350032.008711:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350032.008722:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea340031400/0xd05e6ae1590e327b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3282 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.008743:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea340031400/0xd05e6ae1590e327b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3282 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350032.008758:0:17819:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783350032.008873:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031400/0xd05e6ae1590e327b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3282 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.008881:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea340031400/0xd05e6ae1590e327b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3282 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350032.008889:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ea348c55800 10000000:01000000:0.0:1783350032.008893:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783350032.008896:0:17819:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8ea348c55800 from 1 10000000:01000000:0.0:1783350032.008898:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783350032.008913:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.008920:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.008926:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350032.008938:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350032.008963:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.009063:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52600 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.009094:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659543680 00000100:00100000:2.0:1783350032.009098:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659543680 00000100:00100000:2.0:1783350032.009124:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783350032.009130:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+13:17819:x1869977659543680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350032.009224:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350032.009235:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c6a00/0xd05e6ae1590e3290 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3289 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350032.009250:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c6a00/0xd05e6ae1590e3290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3289 expref: 14 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350032.009259:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c6a00/0xd05e6ae1590e3290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3289 expref: 14 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350032.009266:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6a00, rc 0) 00000100:00100000:2.0:1783350032.009295:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+14:17819:x1869977659543680:12345-0@lo:101:mount.lustre.0 Request processed in 165us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.009301:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783350032.009311:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350032.009321:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.009335:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350032.009347:0:17819:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783350032.009361:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.009368:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364b200/0xd05e6ae1590e3289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3290 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350032.009374:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1783350032.009377:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783350032.009382:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ea348c55800 10000000:01000000:0.0:1783350032.009385:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783350032.009388:0:17819:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1783350032.009390:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783350032.009403:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.009419:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.009426:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350032.009437:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350032.009461:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.009485:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52600 going to sleep for 11 seconds 00000100:00100000:3.0:1783350032.009579:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659543808 00000100:00100000:3.0:1783350032.009583:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659543808 00000100:00100000:3.0:1783350032.009613:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783350032.009620:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+14:17819:x1869977659543808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350032.009626:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350032.009633:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e329e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3297 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.009643:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e329e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3297 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.009648:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea340031800/0xd05e6ae1590e329e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3297 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.009660:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031800, rc 0) 00000100:00100000:3.0:1783350032.009685:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+15:17819:x1869977659543808:12345-0@lo:101:mount.lustre.0 Request processed in 67us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350032.009689:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783350032.009757:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350032.009764:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.009878:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783350032.014565:0:17819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1783350032.015303:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783350032.019713:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783350032.019768:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1783350032.019847:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1783350032.019863:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1783350032.019878:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1783350032.019892:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1783350032.019906:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1783350032.019919:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1783350032.020008:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1783350032.020026:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1783350032.020040:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1783350032.020053:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1783350032.020066:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1783350032.020080:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1783350032.020092:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1783350032.020104:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1783350032.020118:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1783350032.020132:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1783350032.020225:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1783350032.020237:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1783350032.020250:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1783350032.020263:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1783350032.020278:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1783350032.020314:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1783350032.020319:0:17819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1783350032.020432:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350032.020497:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.020540:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f526c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.020871:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659543936 00000100:00100000:2.0:1783350032.020879:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659543936 00000100:00100000:2.0:1783350032.020929:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783350032.020938:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+15:17819:x1869977659543936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350032.021076:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+15:17819:x1869977659543936:12345-0@lo:501:mount.lustre.0 Request processed in 138us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.021083:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783350032.021261:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659543936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350032.021294:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659544064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350032.021333:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.021449:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f526c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350032.022127:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659544064 00000100:00100000:1.0:1783350032.022163:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659544064 00000100:00100000:1.0:1783350032.022201:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783350032.022209:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+15:17819:x1869977659544064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350032.023384:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+15:17819:x1869977659544064:12345-0@lo:503:mount.lustre.0 Request processed in 1172us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350032.023394:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783350032.024350:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659544064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783350032.025248:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783350032.025329:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659544192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350032.025395:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.025503:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52600 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.025985:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659544192 00000100:00100000:2.0:1783350032.025992:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659544192 00000100:00100000:2.0:1783350032.026078:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783350032.026086:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+15:17819:x1869977659544192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350032.027025:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+15:17819:x1869977659544192:12345-0@lo:502:mount.lustre.0 Request processed in 937us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.027035:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783350032.027121:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659544192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350032.027334:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783350032.027364:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1783350032.027382:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1783350032.027397:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1783350032.027426:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1783350032.027439:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1783350032.027479:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1783350032.027495:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1783350032.027508:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1783350032.027521:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1783350032.027533:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1783350032.027560:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1783350032.027588:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1783350032.027604:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1783350032.027619:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1783350032.027633:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1783350032.027647:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1783350032.027662:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1783350032.027678:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1783350032.027693:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1783350032.027706:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1783350032.027720:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1783350032.027733:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1783350032.027747:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1783350032.027764:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1783350032.027793:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1783350032.027808:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1783350032.027823:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1783350032.027839:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1783350032.027852:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1783350032.027866:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1783350032.027881:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1783350032.027896:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1783350032.027910:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1783350032.027925:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1783350032.027938:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1783350032.027951:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1783350032.027964:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1783350032.027978:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1783350032.027992:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1783350032.028004:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1783350032.028017:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1783350032.028030:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1783350032.028043:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1783350032.028078:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659544320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350032.028159:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.029019:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52600 going to sleep for 11 seconds 00000100:00100000:3.0:1783350032.029107:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659544320 00000100:00100000:3.0:1783350032.029116:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659544320 00000100:00100000:3.0:1783350032.029180:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783350032.029189:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+15:17819:x1869977659544320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350032.029323:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+15:17819:x1869977659544320:12345-0@lo:502:mount.lustre.0 Request processed in 135us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350032.029331:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783350032.029922:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659544320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350032.029994:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1783350032.030006:0:17819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1783350032.031531:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350032.031553:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350032.031555:0:17823:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783350032.031561:0:17823:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1783350032.031565:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783350032.031579:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8ea349e34d40) 00000020:00000080:0.0:1783350032.031600:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1783350032.031606:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783350032.031685:0:17823:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783350032.031691:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e32ac 00000020:00000080:0.0:1783350032.031951:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1783350032.031956:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783350032.031959:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350032.031961:0:17823:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783350032.031964:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783350032.031967:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783350032.031969:0:17823:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1783350032.031972:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783350032.031980:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8ea349e30000) 00000020:00000080:0.0:1783350032.031990:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1783350032.031993:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783350032.031995:0:17823:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1783350032.031998:0:17823:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1783350032.032003:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783350032.032062:0:17823:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea348c55800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1783350032.032075:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8ea349e319c0) 00000020:00000080:0.0:1783350032.032090:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1783350032.032263:0:17823:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783350032.032270:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e32c1 00000020:00000080:0.0:1783350032.032358:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1783350032.032365:0:17823:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783350032.032370:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd05e6ae1590e32c8 00080000:01000000:0.0:1783350032.032375:0:17823:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783350032.032379:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e32cf 00010000:00010000:1.0:1783350032.069060:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350032.083501:0:17823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1783350032.084214:0:17823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1783350032.084518:0:17823:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783350032.085669:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1783350032.085681:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350032.085687:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350032.085689:0:17823:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1783350032.085692:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783350032.085697:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350032.085699:0:17823:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1783350032.085702:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783350032.085708:0:17823:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:00000080:3.0:1783350032.085732:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783350032.085747:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8ea37f45b380) 00000020:00000080:3.0:1783350032.085776:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1783350032.085783:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783350032.086003:0:17823:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1783350032.086010:0:17823:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783350032.086018:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e32dd 00010000:00080000:3.0:1783350032.086047:0:17823:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea375e3d800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1783350032.091497:0:17823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1783350032.092926:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783350032.092940:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783350032.093058:0:17823:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783350032.093082:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e32e4 00000100:00080000:2.0:1783350032.093092:0:17823:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783350032.093098:0:17823:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ea375e3d800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350032.093133:0:17823:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243081f80 x1869977659544448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783350032.093403:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659544448:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783350032.093509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783350032.093580:0:17823:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783350032.093607:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783350032.093611:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783350032.093613:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350032.093618:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:2.0:1783350032.093621:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783350032.093625:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea345adf000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350032.093640:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243082a00 x1869977659544576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350032.093701:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659544448 00000100:00100000:3.0:1783350032.093708:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659544448 00000100:00100000:3.0:1783350032.093737:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783350032.093744:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869977659544448:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783350032.093766:0:17093:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1783350032.093793:0:17093:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e32eb 00000004:00100000:3.0:1783350032.093806:0:17093:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783350032.093811:0:17093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1783350032.093918:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659544576:0@lo:38:kworker.0 00000100:00100000:0.0:1783350032.093947:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783350032.094207:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350032.094338:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783350032.094342:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350032.094345:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783350032.094394:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783350032.094403:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659544704:0@lo:400:kworker.0 00000100:00100000:2.0:1783350032.094436:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350032.094468:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659544704 00000100:00100000:2.0:1783350032.094472:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659544704 00000100:00100000:2.0:1783350032.094506:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783350032.094512:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659544704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350032.094567:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659544704:12345-0@lo:400:kworker.0 Request processed in 53us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.094574:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783350032.094613:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea243083480 x1869977659544704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350032.094627:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659544704:0@lo:400:kworker.0 00000020:01000000:2.0:1783350032.094888:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350032.094894:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.094896:0:17823:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1783350032.094899:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783350032.094902:0:17823:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1783350032.094904:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350032.094905:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350032.094906:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783350032.094909:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.094910:0:17823:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783350032.094912:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350032.094916:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.094917:0:17823:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1783350032.094920:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783350032.095507:0:17823:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783350032.095530:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350032.095542:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.095554:0:17823:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1783350032.095558:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783350032.095561:0:17823:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1783350032.095562:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350032.095563:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350032.095565:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783350032.095568:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.095570:0:17823:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783350032.095572:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783350032.095576:0:17823:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1783350032.095579:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.095580:0:17823:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783350032.095583:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783350032.095587:0:17823:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:2.0:1783350032.095608:0:17823:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1783350032.095611:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783350032.095627:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8ea349f8b380) 00000020:00000080:2.0:1783350032.095643:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1783350032.095650:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783350032.095722:0:17823:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1783350032.095729:0:17823:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783350032.095736:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e32f9 00010000:00080000:2.0:1783350032.095765:0:17823:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea24271f000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.150@tcp at head 00000100:00100000:3.0:1783350032.096174:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1783350032.096182:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00010000:2.0:1783350032.096442:0:17823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1783350032.097509:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659544576 00000100:00100000:2.0:1783350032.097519:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659544576 00000100:00100000:3.0:1783350032.097939:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783350032.097946:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869977659544576:12345-0@lo:38:kworker.0 00000040:01000000:2.0:1783350032.098176:0:17823:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783350032.098530:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869977659544576:12345-0@lo:38:kworker.0 Request processed in 581us (4580us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783350032.098539:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:01000000:2.0:1783350032.098640:0:17823:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1783350032.099726:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783350032.099736:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350032.099747:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783350032.099752:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659544576:0@lo:38:kworker.0 00000040:00080000:2.0:1783350032.101010:0:17823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1783350032.102794:0:17093:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783350032.103010:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1869977659544448:12345-0@lo:38:llog_process_th.0 Request processed in 9262us (9498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350032.103021:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1783350032.107098:0:17823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1783350032.107307:0:17823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1783350032.107755:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783350032.107920:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1783350032.107931:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783350032.107936:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783350032.107940:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea375e3d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783350032.107962:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659544448:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783350032.108099:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659544832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783350032.108192:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350032.108680:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659544832 00000100:00100000:2.0:1783350032.108687:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659544832 00000100:00100000:2.0:1783350032.108728:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350032.108746:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1869977659544832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350032.108891:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783350032.109020:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1869977659544832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 274us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.109028:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783350032.109388:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659544832:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783350032.109880:0:17829:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783350032.109886:0:17829:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783350032.110727:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783350032.110737:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783350032.110882:0:17823:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783350032.110904:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e3300 00000100:00080000:2.0:1783350032.110914:0:17823:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783350032.110918:0:17823:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ea24271f000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350032.110948:0:17823:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243083480 x1869977659544960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783350032.111005:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659544960:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783350032.111055:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659544960 offset 0 length 520: 4 00000100:00080000:2.0:1783350032.111105:0:17823:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783350032.111187:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350032.111191:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.111193:0:17823:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783350032.111195:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783350032.111198:0:17823:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1783350032.111199:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350032.111201:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783350032.111202:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783350032.111204:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.111206:0:17823:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783350032.111207:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783350032.111211:0:17823:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1783350032.111214:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.111215:0:17823:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783350032.111227:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783350032.111231:0:17823:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:2.0:1783350032.111249:0:17823:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1783350032.111251:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783350032.111261:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8ea349f88000) 00000020:00000080:2.0:1783350032.111273:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1783350032.111277:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783350032.111342:0:17823:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1783350032.111358:0:17823:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783350032.111363:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd05e6ae1590e330e 00010000:00080000:2.0:1783350032.111386:0:17823:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea349fe1800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1783350032.111588:0:17823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1783350032.111644:0:17823:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783350032.111656:0:17823:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1783350032.112121:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350032.112147:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350032.112150:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350032.112159:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1783350032.115637:0:17823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783350032.115893:0:17823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1783350032.116027:0:17823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1783350032.116954:0:17831:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783350032.116959:0:17831:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783350032.118056:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783350032.118069:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783350032.118108:0:17823:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783350032.118127:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e3315 00000100:00080000:2.0:1783350032.118290:0:17823:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783350032.118297:0:17823:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea349fe1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350032.118329:0:17823:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243083b80 x1869977659545088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783350032.118487:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659545088:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783350032.118560:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659545088 offset 0 length 520: 4 00000100:00080000:2.0:1783350032.118609:0:17823:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783350032.118698:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350032.118702:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.118704:0:17823:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783350032.118707:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350032.118715:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.118717:0:17823:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783350032.118720:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783350032.118721:0:17823:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783350032.118723:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350032.118725:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.118726:0:17823:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783350032.118728:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350032.118730:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.118731:0:17823:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783350032.118734:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783350032.118756:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350032.118758:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350032.118759:0:17823:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783350032.118762:0:17823:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1783350032.118958:0:17819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1783350032.118985:0:17819:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783350032.119002:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.119013:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364b000/0xd05e6ae1590e3297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e329e expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350032.119022:0:17819:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea348c55800 from 1 10000000:01000000:3.0:1783350032.119024:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783350032.119048:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.119056:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.119067:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350032.119082:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350032.119121:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350032.119168:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f529c0 going to sleep for 11 seconds 00000100:00080000:3.0:1783350032.119188:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350032.119193:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350032.119196:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350032.119198:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783350032.119379:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659545216 00000100:00100000:2.0:1783350032.119387:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659545216 00000100:00100000:2.0:1783350032.119562:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783350032.119571:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+15:17819:x1869977659545216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350032.119584:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350032.119596:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c6200/0xd05e6ae1590e3323 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e331c expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350032.119616:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c6200/0xd05e6ae1590e3323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e331c expref: 16 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350032.119626:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c6200/0xd05e6ae1590e3323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e331c expref: 16 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350032.119634:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6200, rc 0) 00000100:00100000:2.0:1783350032.119670:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+16:17819:x1869977659545216:12345-0@lo:101:mount.lustre.0 Request processed in 100us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.119686:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783350032.119776:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350032.119787:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.119792:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350032.120369:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545344:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783350032.120698:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350032.120730:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350032.120778:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659545344 00000100:00100000:1.0:1783350032.120784:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659545344 00000100:00100000:1.0:1783350032.120821:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783350032.120829:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+16:17819:x1869977659545344:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783350032.120845:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783350032.120862:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783350032.120865:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1783350032.121228:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+16:17819:x1869977659545344:12345-0@lo:256:mount.lustre.0 Request processed in 384us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350032.121236:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783350032.121539:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545344:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783350032.122878:0:17819:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783350032.122944:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.123070:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350032.123082:0:17819:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea348c55800 from 1 10000000:01000000:3.0:1783350032.123085:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783350032.123119:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.123127:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.123153:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350032.123191:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350032.123263:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350032.123299:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.123322:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659545472 00000100:00100000:2.0:1783350032.123329:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659545472 00000100:00100000:2.0:1783350032.123387:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783350032.123397:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+16:17819:x1869977659545472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350032.123417:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350032.123430:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c7c00/0xd05e6ae1590e3331 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e332a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350032.123451:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c7c00/0xd05e6ae1590e3331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e332a expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350032.123460:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c7c00/0xd05e6ae1590e3331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e332a expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350032.123468:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7c00, rc 0) 00000100:00100000:2.0:1783350032.123515:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17819:x1869977659545472:12345-0@lo:101:mount.lustre.0 Request processed in 120us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.123522:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783350032.123618:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783350032.123631:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.123639:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783350032.123775:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783350032.123812:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350032.123839:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.123867:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350032.123916:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659545600 00000100:00100000:3.0:1783350032.123921:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659545600 00000100:00100000:3.0:1783350032.123956:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783350032.123963:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17819:x1869977659545600:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350032.124040:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17819:x1869977659545600:12345-0@lo:501:mount.lustre.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350032.124046:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783350032.124075:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350032.124099:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545728:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783350032.124133:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350032.124180:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659545728 00000100:00100000:1.0:1783350032.124184:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659545728 00000100:00100000:3.0:1783350032.124187:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3445279c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350032.124210:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783350032.124361:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17819:x1869977659545728:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350032.124483:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17819:x1869977659545728:12345-0@lo:503:mount.lustre.0 Request processed in 125us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.124513:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545728:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783350032.124863:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783350032.124921:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350032.125098:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350032.125123:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3462683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350032.125224:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659545856 00000100:00100000:3.0:1783350032.125232:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659545856 00000100:00100000:1.0:1783350032.128536:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783350032.128616:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783350032.128630:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17819:x1869977659545856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350032.128836:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17819:x1869977659545856:12345-0@lo:502:mount.lustre.0 Request processed in 211us (3736us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350032.128843:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783350032.128908:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350032.129653:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783350032.129692:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1783350032.129706:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1783350032.129718:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1783350032.129730:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1783350032.129742:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1783350032.129754:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1783350032.129767:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1783350032.129780:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783350032.129793:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1783350032.129808:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1783350032.129842:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350032.129892:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350032.129929:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3462683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350032.130179:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659545984 00000100:00100000:0.0:1783350032.130186:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659545984 00000100:00100000:3.0:1783350032.130284:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783350032.130294:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17819:x1869977659545984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350032.130401:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17819:x1869977659545984:12345-0@lo:502:mount.lustre.0 Request processed in 109us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350032.130557:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659545984:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350032.130617:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1783350032.130625:0:17819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:3.0:1783350032.130794:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000020:01000000:1.0:1783350032.131167:0:17833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350032.131177:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350032.131179:0:17833:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783350032.131186:0:17833:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea348c55800 00000020:00000080:1.0:1783350032.131188:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350032.131195:0:17833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350032.131198:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350032.131199:0:17833:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783350032.131201:0:17833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350032.131204:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350032.131205:0:17833:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783350032.131208:0:17833:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea348c55800 00000020:00000080:1.0:1783350032.131210:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350032.131260:0:17833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350032.131263:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350032.131265:0:17833:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783350032.131267:0:17833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350032.131270:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350032.131271:0:17833:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783350032.131275:0:17833:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea348c55800 00000020:00000080:1.0:1783350032.131285:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350032.131306:0:17833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350032.131308:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350032.131309:0:17833:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783350032.131312:0:17833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350032.131314:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350032.131315:0:17833:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783350032.131318:0:17833:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea348c55800 00000020:00000080:1.0:1783350032.131321:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783350032.131343:0:17833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350032.131346:0:17833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350032.131347:0:17833:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783350032.131350:0:17833:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1783350032.131489:0:17819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783350032.131509:0:17819:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783350032.131527:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.131537:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350032.131587:0:17819:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783350032.131598:0:17819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea348c55800 10000000:01000000:0.0:1783350032.131601:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea348c55800 10000000:01000000:0.0:1783350032.131605:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783350032.131610:0:17819:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea348c55800 from 1 10000000:01000000:0.0:1783350032.131612:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783350032.131639:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.131648:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.131657:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350032.131684:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546112:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783350032.131722:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.131754:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783350032.131970:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659546112 00000100:00100000:3.0:1783350032.131976:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659546112 00000100:00100000:3.0:1783350032.132016:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783350032.132024:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17819:x1869977659546112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350032.132042:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350032.132054:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea340030200/0xd05e6ae1590e333f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3338 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.132076:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea340030200/0xd05e6ae1590e333f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3338 expref: 18 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.132086:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea340030200/0xd05e6ae1590e333f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3338 expref: 18 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.132095:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030200, rc 0) 00000100:00100000:3.0:1783350032.132157:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546112:12345-0@lo:101:mount.lustre.0 Request processed in 106us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350032.132164:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783350032.132202:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350032.132215:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.132224:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783350032.139438:0:17819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1783350032.139743:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783350032.139950:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1783350032.140121:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1783350032.140133:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1783350032.140177:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1783350032.140206:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1783350032.140221:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1783350032.140233:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1783350032.140245:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1783350032.140259:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1783350032.140272:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1783350032.140282:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1783350032.140294:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1783350032.140305:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1783350032.140317:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1783350032.140329:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1783350032.140343:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1783350032.140356:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1783350032.140369:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1783350032.140391:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1783350032.140405:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1783350032.140433:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1783350032.140449:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1783350032.140462:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1783350032.140477:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1783350032.140491:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1783350032.140504:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1783350032.140516:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1783350032.140529:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1783350032.140558:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1783350032.140565:0:17819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1783350032.140640:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350032.140699:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350032.140739:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348db73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.141233:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659546240 00000100:00100000:2.0:1783350032.141242:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659546240 00000100:00100000:2.0:1783350032.141294:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783350032.141302:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350032.141424:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546240:12345-0@lo:501:mount.lustre.0 Request processed in 122us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.141431:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783350032.141477:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350032.141513:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350032.141560:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350032.141583:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659546368 00000100:00100000:2.0:1783350032.141587:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659546368 00000100:00100000:2.0:1783350032.141608:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783350032.141614:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350032.141683:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546368:12345-0@lo:503:mount.lustre.0 Request processed in 67us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.141696:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783350032.141730:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.141743:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546368:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783350032.144204:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783350032.144313:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350032.144379:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350032.144413:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659546496 00000100:00100000:2.0:1783350032.144419:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659546496 00000100:00100000:2.0:1783350032.144456:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783350032.144464:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350032.144566:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546496:12345-0@lo:502:mount.lustre.0 Request processed in 101us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.144573:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783350032.144626:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.144644:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350032.144814:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783350032.144839:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1783350032.144855:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1783350032.144867:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1783350032.144880:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1783350032.144894:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1783350032.144911:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1783350032.144925:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1783350032.144936:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1783350032.144949:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1783350032.144959:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1783350032.145695:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1783350032.145722:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1783350032.145737:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1783350032.145762:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1783350032.145778:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1783350032.145792:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1783350032.145803:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1783350032.145816:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1783350032.145829:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1783350032.145840:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1783350032.145853:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1783350032.145866:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1783350032.145881:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1783350032.145894:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1783350032.145906:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1783350032.145920:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1783350032.145933:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1783350032.145946:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1783350032.147150:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1783350032.147498:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1783350032.147516:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1783350032.147530:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1783350032.147542:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1783350032.147568:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1783350032.147580:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1783350032.147593:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1783350032.147606:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1783350032.147621:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1783350032.147634:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1783350032.147646:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1783350032.147658:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1783350032.147671:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1783350032.147684:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1783350032.147697:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1783350032.147719:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1783350032.147746:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1783350032.147763:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1783350032.147822:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350032.147891:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350032.148045:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350032.148367:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659546624 00000100:00100000:1.0:1783350032.148375:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659546624 00000100:00100000:1.0:1783350032.148453:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783350032.148463:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350032.148587:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546624:12345-0@lo:502:mount.lustre.0 Request processed in 125us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350032.148594:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783350032.148665:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350032.148825:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1783350032.148847:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1783350032.148870:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350032.148905:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350032.148930:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659546752 00000100:00100000:2.0:1783350032.148934:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659546752 00000100:00100000:2.0:1783350032.148957:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783350032.149092:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350032.149178:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659546752:12345-0@lo:502:mount.lustre.0 Request processed in 215us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.149185:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783350032.149222:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.149235:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659546752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350032.149269:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1783350032.149277:0:17819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783350032.149890:0:17837:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1783350032.149904:0:17837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8ea241dc99c0) 00000020:00000080:1.0:1783350032.149924:0:17837:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1783350032.150283:0:17837:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea348c55800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783350032.150287:0:17837:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea348c55800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783350032.150290:0:17837:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea348c55800 3 00010000:00080000:1.0:1783350032.150323:0:17837:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea36d6f7000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783350032.152194:0:17837:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1783350032.152293:0:17837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1783350032.152333:0:17837:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783350032.152345:0:17837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd05e6ae1590e334d 00000100:00080000:1.0:1783350032.152355:0:17837:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783350032.152361:0:17837:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ea36d6f7000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350032.152393:0:17837:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244526680 x1869977659546880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783350032.152425:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659546880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783350032.152496:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350032.152560:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659546880 00000100:00100000:1.0:1783350032.152567:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659546880 00000100:00100000:1.0:1783350032.152600:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783350032.152606:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869977659546880:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783350032.152626:0:17089:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1783350032.152651:0:17089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd05e6ae1590e3354 00000004:00100000:1.0:1783350032.152663:0:17089:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783350032.152692:0:17089:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783350032.152738:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869977659546880:12345-0@lo:38:llog_process_th.0 Request processed in 131us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350032.152746:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783350032.152778:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea244526680 x1869977659546880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350032.152788:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783350032.152794:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1783350032.152800:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783350032.152804:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783350032.152812:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783350032.152818:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869977659546880:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783350032.152835:0:17837:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1783350032.154527:0:17837:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00080000:3.0:1783350032.154552:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350032.154557:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350032.154560:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350032.154562:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1783350032.155109:0:17819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783350032.155155:0:17819:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783350032.155173:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350032.155196:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364a600/0xd05e6ae1590e3338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e333f expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783350032.155247:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783350032.155250:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783350032.155251:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350032.155253:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350032.155254:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350032.155256:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350032.155257:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350032.155259:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350032.155261:0:17819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783350032.155264:0:17819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1783350032.155266:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783350032.155267:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783350032.155269:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350032.155270:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350032.155271:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350032.155272:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350032.155273:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350032.155274:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350032.155275:0:17819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783350032.155295:0:17819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783350032.155312:0:17819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659547008:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783350032.155370:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350032.155401:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659547008 00000100:00100000:2.0:1783350032.155407:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659547008 00000100:00100000:2.0:1783350032.155442:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783350032.155451:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659547008:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783350032.155473:0:17082:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783350032.155485:0:17082:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783350032.155687:0:17819:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66300 going to sleep for 11 seconds 00000001:00100000:2.0:1783350032.161560:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1783350032.161603:0:17082:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783350032.161616:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783350032.162715:0:17103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783350032.162724:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783350032.162746:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.162771:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e325f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3258 expref: 18 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.162779:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3417c6200/0xd05e6ae1590e3323 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e331c expref: 18 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.162787:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350032.163934:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17819:x1869977659547008:12345-0@lo:253:mount.lustre.0 Request processed in 8477us (8557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.163946:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783350032.164013:0:17819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17819:1869977659547008:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783350032.164028:0:17819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783350032.164031:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783350032.164033:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783350032.164034:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783350032.164035:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783350032.164036:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783350032.164037:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783350032.164039:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783350032.164040:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783350032.164042:0:17819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783350032.164056:0:17819:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1783350032.164556:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3417c6200/0xd05e6ae1590e3323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e331c expref: 17 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.164573:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3417c6200/0xd05e6ae1590e3323 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e331c expref: 17 pid: 17079 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350032.164587:0:17103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659547136:0@lo:104: 00000100:00100000:0.0:1783350032.164624:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783350032.164663:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e325f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3258 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.164671:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e325f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3258 expref: 17 pid: 17082 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350032.164685:0:17103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659547264:0@lo:104: 00000100:00100000:0.0:1783350032.164707:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.164720:0:17103:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b58b600 going to sleep for 11 seconds 00000100:00100000:0.0:1783350032.164737:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659547136 00000100:00100000:0.0:1783350032.164743:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659547136 00000100:00100000:0.0:1783350032.164771:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659547264 00000100:00100000:0.0:1783350032.164775:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659547264 00000100:00100000:0.0:1783350032.164787:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350032.164794:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+4:17103:x1869977659547136:12345-0@lo:104: 00010000:00010000:0.0:1783350032.164817:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.164863:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783350032.164869:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+4:17103:x1869977659547136:12345-0@lo:104: Request processed in 75us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350032.164875:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350032.164889:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783350032.164895:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:17103:x1869977659547264:12345-0@lo:104: 00010000:00010000:0.0:1783350032.164902:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.164931:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783350032.164936:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:17103:x1869977659547264:12345-0@lo:104: Request processed in 42us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350032.164943:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783350032.164957:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350032.164963:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.164977:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031600 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350032.164980:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.164988:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350032.164995:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350032.165000:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783350032.165025:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.165031:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350032.165048:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.165055:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e331c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3323 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.165067:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350032.165071:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.165076:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8dc00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350032.165079:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.165095:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350032.165102:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350032.165107:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783350032.165121:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.165127:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350032.165151:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.165158:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3258 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e325f expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.165171:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350032.165173:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350032.165174:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350032.165185:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659547392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350032.165211:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.165233:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783350032.165239:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659547520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350032.165259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350032.165298:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659547392 00000100:00100000:0.0:1783350032.165302:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659547392 00010000:00010000:0.0:1783350032.165320:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3417c6200/0xd05e6ae1590e3323 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e331c expref: 18 pid: 17079 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350032.165348:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659547520 00000100:00100000:0.0:1783350032.165351:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659547520 00010000:00010000:0.0:1783350032.165361:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e325f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3258 expref: 19 pid: 17082 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350032.165373:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350032.165378:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:3646:x1869977659547392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350032.165388:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350032.165393:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3417c6200/0xd05e6ae1590e3323 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e331c expref: 19 pid: 17079 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.165402:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3417c6200/0xd05e6ae1590e3323 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e331c expref: 19 pid: 17079 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350032.168261:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350032.168524:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350032.168610:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:3646:x1869977659547392:12345-0@lo:103:ldlm_bl.0 Request processed in 3227us (3394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350032.168620:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350032.168652:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783350032.168662:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:3646:x1869977659547520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350032.168677:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350032.168684:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e325f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3258 expref: 18 pid: 17082 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.168696:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e325f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3258 expref: 18 pid: 17082 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.168708:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.168722:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783350032.168737:0:17073:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008695573s 00010000:00010000:0.0:1783350032.168741:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.168748:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.168754:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.168760:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.168766:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350032.168771:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.168778:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.168786:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.168795:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350032.169991:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:3646:x1869977659547520:12345-0@lo:103:ldlm_bl.0 Request processed in 1327us (4726us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350032.170001:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783350032.170060:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659547520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350032.170070:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659547392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350032.170105:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3417c6200/0xd05e6ae1590e3323 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e331c expref: 17 pid: 17079 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350032.170117:0:17103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659547136:0@lo:104: 00010000:00010000:0.0:1783350032.170128:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e325f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3258 expref: 16 pid: 17082 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350032.170155:0:17103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659547264:0@lo:104: 00010000:00010000:0.0:1783350032.170171:0:17103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.170180:0:17103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.170186:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350032.170192:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e335b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1783350032.181646:0:17819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1783350032.181718:0:17843:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1783350032.181723:0:17843:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783350032.182000:0:17844:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783350032.182057:0:17819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1783350032.183852:0:17845:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1869977659547648:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783350032.183918:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1783350032.183922:0:17819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1783350032.183954:0:17845:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350032.183970:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659547648 00000100:00100000:3.0:1783350032.183979:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659547648 00000100:00100000:3.0:1783350032.184026:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783350032.184035:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17845:x1869977659547648:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1783350032.184108:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783350032.184130:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17845:x1869977659547648:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350032.184316:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783350032.184504:0:17845:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1869977659547648:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1783350032.184530:0:17845:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783350032.184567:0:17845:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1869977659547776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783350032.184599:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350032.184619:0:17845:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393a480 going to sleep for 11 seconds 00000004:00000080:0.0:1783350032.184706:0:17819:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783350032.184713:0:17819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1783350032.184755:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783350032.184792:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659547776 00000100:00100000:2.0:1783350032.184798:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659547776 00000100:00100000:2.0:1783350032.184828:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783350032.184836:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17845:x1869977659547776:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783350032.184957:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17845:x1869977659547776:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 121us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.184964:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783350032.185129:0:17845:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1869977659547776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783350032.185203:0:17845:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17845:1869977659547904:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783350032.185229:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350032.185250:0:17845:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350a21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.186347:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659547904 00000100:00100000:2.0:1783350032.186357:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659547904 00000100:00100000:2.0:1783350032.186400:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1783350032.186625:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1783350032.186785:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17845:x1869977659547904:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1783350032.186868:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17845:x1869977659547904:12345-0@lo:900:lod0001_rec0000.0 Request processed in 459us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.186886:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783350032.186960:0:17845:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ea244526680 x1869977659547904/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783350048 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350032.186975:0:17845:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17845:1869977659547904:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783350032.187088:0:17845:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1869977659548032:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783350032.187121:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350032.187166:0:17845:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350a210c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350032.187315:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659548032 00000100:00100000:2.0:1783350032.187320:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659548032 00000100:00100000:2.0:1783350032.187342:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783350032.187349:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17845:x1869977659548032:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1783350032.187587:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783350032.187623:0:17819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1783350032.187795:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783350032.187812:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17845:x1869977659548032:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 462us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350032.187820:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783350032.187954:0:17845:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1869977659548032:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1783350032.188059:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783350032.188922:0:17844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783350032.189254:0:17819:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1783350032.192288:0:17819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:1.0:1783350032.195553:0:17845:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783350032.195628:0:17845:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1783350032.196680:0:17844:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783350032.196736:0:17844:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783350032.196740:0:17844:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1783350032.209540:0:17819:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783350032.209586:0:17819:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9d98455d3988 00100000:10000000:2.0:1783350032.209594:0:17819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1783350032.210568:0:17819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783350032.210621:0:17819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783350032.210665:0:17819:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783350032.210841:0:17819:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1783350032.219071:0:17819:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783350032.219330:0:17819:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783350032.966632:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:0.0:1783350033.093365:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783350033.222304:0:17847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1783350033.414230:0:17084:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783350033.414237:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea348c55800 from 8 10000000:01000000:0.0:1783350033.414253:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783350033.414300:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350033.414313:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350033.414324:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350033.414350:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659548160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783350033.414740:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350033.414804:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351466f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783350033.415089:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659548160 00000100:00100000:3.0:1783350033.415098:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659548160 00000100:00100000:3.0:1783350033.415169:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783350033.415180:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+16:17084:x1869977659548160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350033.415193:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350033.415211:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3369 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3362 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350033.415236:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3362 expref: 17 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350033.415411:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3362 expref: 17 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350033.415422:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031e00, rc 0) 00000100:00100000:3.0:1783350033.415482:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17084:x1869977659548160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 304us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350033.415490:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783350033.415642:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659548160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783350033.415658:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350033.415667:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350033.415734:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659548288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783350033.415769:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350033.415797:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351466f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783350033.415910:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659548288 00000100:00100000:3.0:1783350033.415915:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659548288 00000100:00100000:3.0:1783350033.415979:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783350033.415988:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17084:x1869977659548288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783350033.416003:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783350033.416204:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783350033.416208:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783350033.417358:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17084:x1869977659548288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1367us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350033.417370:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783350033.425387:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659548288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783350033.425471:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783350033.425482:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350033.425494:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350033.425506:0:17084:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783350033.425508:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea37f5b5800 from 8 10000000:01000000:0.0:1783350033.425511:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783350033.425552:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350033.425560:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350033.425569:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350033.425590:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659548416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783350033.425649:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350033.425694:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351466f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783350033.425814:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659548416 00000100:00100000:3.0:1783350033.425821:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659548416 00000100:00100000:3.0:1783350033.425875:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783350033.425884:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17084:x1869977659548416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350033.425898:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350033.425911:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e3377 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3370 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350033.425932:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e3377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3370 expref: 18 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350033.425942:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e3377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3370 expref: 18 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350033.425951:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030a00, rc 0) 00000100:00100000:3.0:1783350033.425988:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17084:x1869977659548416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350033.426003:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783350033.427221:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659548416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783350033.427366:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350033.427378:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350033.427451:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659548544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783350033.427502:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350033.427548:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea351466f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783350033.427660:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659548544 00000100:00100000:3.0:1783350033.427666:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659548544 00000100:00100000:3.0:1783350033.427710:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783350033.427719:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17084:x1869977659548544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783350033.427737:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783350033.427754:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783350033.427757:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783350033.427838:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17084:x1869977659548544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350033.427846:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783350033.427917:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659548544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783350033.427958:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783350033.427965:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350033.427974:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350033.989895:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:3.0:1783350034.134356:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783350034.244772:0:17847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783350035.012217:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:0.0:1783350035.140516:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783350035.587076:0:18090:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783350036.036310:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00010000:00010000:3.0:1783350036.168541:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783350036.250660:0:18142:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783350036.253419:0:18142:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783350037.061200:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 0 seconds 00000020:00000004:1.0:1783350037.098613:0:18192:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783350037.098815:0:18192:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783350037.192824:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350037.385769:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659548672:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1783350037.385957:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783350037.385962:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783350037.385965:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783350037.385973:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ea345adf000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350037.385994:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea244524a80 x1869977659548928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350037.386012:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350037.386015:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783350037.386164:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350037.386217:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783350037.386224:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659548800:0@lo:400:kworker.0 00000100:00100000:0.0:1783350037.386252:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350037.386286:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659548800 00000100:00100000:0.0:1783350037.386292:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659548800 00000100:00100000:0.0:1783350037.386330:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783350037.386345:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:3648:x1869977659548800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783350037.386468:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350037.386472:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350037.386496:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350037.386500:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350037.386502:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350037.386517:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783350037.386560:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659548928:0@lo:38:kworker.0 00000100:00100000:1.0:1783350037.386594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350037.386628:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659548672 00000100:00100000:1.0:1783350037.386632:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659548672 00000100:00100000:1.0:1783350037.386656:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659548928 00000100:00100000:1.0:1783350037.386658:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659548928 00000100:00100000:1.0:1783350037.386667:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350037.386673:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659548672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783350037.386698:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783350037.386865:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783350037.386870:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869977659548928:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783350037.386893:0:17828:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1783350037.386929:0:17828:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e337e 00000004:00100000:2.0:1783350037.386943:0:17828:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783350037.386948:0:17828:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1783350037.387491:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659548672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 816us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350037.387499:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350037.390274:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659549056:0@lo:400:kworker.0 00000100:00100000:1.0:1783350037.390346:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350037.390395:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350037.390402:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659549184:0@lo:400:kworker.0 00000100:00100000:1.0:1783350037.390427:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350037.390530:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659549056 00000100:00100000:1.0:1783350037.390537:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659549056 00000100:00100000:1.0:1783350037.390577:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659549184 00000100:00100000:1.0:1783350037.390580:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659549184 00000100:00100000:1.0:1783350037.390597:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783350037.390605:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659549056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350037.390654:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659549056:12345-0@lo:400:kworker.0 Request processed in 49us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350037.390661:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783350037.390678:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783350037.390684:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659549184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350037.390723:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659549184:12345-0@lo:400:kworker.0 Request processed in 40us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350037.391863:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783350037.391938:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea244524e00 x1869977659549184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350037.391952:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659549184:0@lo:400:kworker.0 00010000:00080000:1.0:1783350037.391964:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea244524000 x1869977659549056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350037.391972:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659549056:0@lo:400:kworker.0 00000100:00100000:0.0:1783350037.392923:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:3648:x1869977659548800:12345-0@lo:400:kworker.0 Request processed in 6572us (6663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350037.392933:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783350037.393000:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659548800:0@lo:400:kworker.0 00000100:00100000:0.0:1783350037.393074:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659548672:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1783350037.412982:0:17828:0:(import.c:65:import_set_state_nolock()) ffff8ea36d6f3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783350037.413078:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869977659548928:12345-0@lo:38:kworker.0 Request processed in 26204us (26481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350037.413089:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1783350037.413266:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783350037.413276:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783350037.413281:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783350037.413284:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea345adf000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1783350037.413299:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cb1b7338): req@ffff8ea244526300 x1869977659541888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350037.413315:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659548928:0@lo:38:kworker.0 00000100:00100000:3.0:1783350037.413377:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350037.413418:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea342f66180 going to sleep for 11 seconds 00000100:00100000:3.0:1783350037.413445:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659541888 00000100:00100000:3.0:1783350037.413451:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659541888 00000100:00100000:3.0:1783350037.413486:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783350037.413494:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17128:x1869977659541888:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783350037.413570:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17128:x1869977659541888:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350037.413577:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783350037.413602:0:17128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244526300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17128:1869977659541888:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783350037.413629:0:17128:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783350037.413666:0:17128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17128:1869977659549312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783350037.413694:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350037.413715:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea346268540 going to sleep for 11 seconds 00000100:00100000:3.0:1783350037.413725:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659549312 00000100:00100000:3.0:1783350037.413739:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659549312 00000100:00100000:3.0:1783350037.413760:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783350037.413767:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17128:x1869977659549312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783350037.414029:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17128:x1869977659549312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 262us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350037.414035:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783350037.414061:0:17128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17128:1869977659549312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783350037.414114:0:17128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17128:1869977659549440:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783350037.414230:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350037.414245:0:17128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cec80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350037.414258:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659549440 00000100:00100000:3.0:1783350037.414261:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659549440 00000100:00100000:3.0:1783350037.414281:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783350037.414294:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17128:x1869977659549440:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783350037.414337:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17128:x1869977659549440:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 44us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350037.414343:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783350037.414367:0:17128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17128:1869977659549440:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783350037.414465:0:17128:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783350037.416639:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659549568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350037.416695:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350037.419025:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659549568 00000100:00100000:2.0:1783350037.419037:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659549568 00000100:00100000:2.0:1783350037.419094:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783350037.419104:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659549568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783350037.419166:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350037.419242:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869977659549568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (2546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350037.419265:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783350037.419321:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659549568:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783350037.419867:0:17128:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783350037.419933:0:17128:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:3.0:1783350037.419938:0:17128:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000080:1.0:1783350037.957655:0:18240:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf05278a0 20000000:00000080:1.0:1783350037.957674:0:18240:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ea36d414400 uarg=0000000000000000 20000000:01000000:1.0:1783350037.957710:0:18240:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783350037.957716:0:18240:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783350037.957721:0:18240:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783350037.958443:0:18241:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1783350037.958588:0:18240:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783350037.969607:0:18240:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783350037.973728:0:18240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350037.973755:0:18240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea340031c00/0xd05e6ae1590e322e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3227 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350037.973762:0:18240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3417c7c00/0xd05e6ae1590e3331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e332a expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350037.973770:0:18240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350037.973818:0:18240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3417c7c00/0xd05e6ae1590e3331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e332a expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350037.973832:0:18240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3417c7c00/0xd05e6ae1590e3331 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e332a expref: 17 pid: 17082 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350037.973894:0:18240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18240:1869977659549696:0@lo:104: 00000100:00100000:0.0:1783350037.973962:0:18240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783350037.974204:0:18240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea340031c00/0xd05e6ae1590e322e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3227 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350037.974213:0:18240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea340031c00/0xd05e6ae1590e322e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3227 expref: 17 pid: 17082 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350037.974222:0:18240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18240:1869977659549824:0@lo:104: 00000100:00100000:0.0:1783350037.974245:0:18240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350037.977019:0:18240:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393a300 going to sleep for 11 seconds 00000100:00100000:1.0:1783350037.987080:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659549696 00000100:00100000:1.0:1783350037.987095:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659549696 00000100:00100000:1.0:1783350037.987174:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659549824 00000100:00100000:1.0:1783350037.987177:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659549824 00000100:00100000:1.0:1783350037.987192:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783350037.987200:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+4:18240:x1869977659549696:12345-0@lo:104: 00010000:00010000:1.0:1783350037.987217:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987323:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783350037.987330:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+4:18240:x1869977659549696:12345-0@lo:104: Request processed in 131us (13368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350037.987337:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783350037.987354:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783350037.987359:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:18240:x1869977659549824:12345-0@lo:104: 00010000:00010000:1.0:1783350037.987367:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987400:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783350037.987405:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:18240:x1869977659549824:12345-0@lo:104: Request processed in 47us (13160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350037.987411:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783350037.987429:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783350037.987434:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987441:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030c00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350037.987445:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987454:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350037.987461:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350037.987466:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783350037.987528:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987535:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783350037.987558:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987565:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340030c00/0xd05e6ae1590e332a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3331 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987580:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350037.987584:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987589:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350037.987592:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987599:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350037.987606:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350037.987611:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783350037.987623:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987628:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783350037.987643:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987659:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea340030800/0xd05e6ae1590e3227 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e322e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350037.987673:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350037.987675:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350037.987676:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350037.987781:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783350037.987796:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659549952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350037.987837:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350037.987880:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659549952 00000100:00100000:2.0:1783350037.987884:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659549952 00010000:00010000:2.0:1783350037.987903:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3417c7c00/0xd05e6ae1590e3331 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e332a expref: 18 pid: 17082 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350037.987924:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783350037.987930:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:3648:x1869977659549952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783350037.987941:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350037.987946:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3417c7c00/0xd05e6ae1590e3331 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e332a expref: 18 pid: 17082 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.987957:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3417c7c00/0xd05e6ae1590e3331 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e332a expref: 18 pid: 17082 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.987973:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783350037.987996:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:3648:x1869977659549952:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350037.988002:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783350037.988095:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659549952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783350037.988163:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350037.988427:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3417c7c00/0xd05e6ae1590e3331 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e332a expref: 17 pid: 17082 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350037.988438:0:18240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18240:1869977659549696:0@lo:104: 00000100:00100000:0.0:1783350037.988446:0:18240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18240:1869977659549824:0@lo:104: 00010000:00010000:0.0:1783350037.988461:0:18240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350037.988516:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659550080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350037.988543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350037.988934:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659550080 00000100:00100000:2.0:1783350037.988939:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659550080 00010000:00010000:2.0:1783350037.988957:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea340031c00/0xd05e6ae1590e322e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3227 expref: 17 pid: 17082 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350037.988983:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783350037.988989:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:3646:x1869977659550080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783350037.988999:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350037.989004:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea340031c00/0xd05e6ae1590e322e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3227 expref: 17 pid: 17082 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989013:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea340031c00/0xd05e6ae1590e322e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3227 expref: 17 pid: 17082 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989026:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea340031c00/0xd05e6ae1590e322e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3227 expref: 17 pid: 17082 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989038:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989047:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989059:0:17072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989065:0:17072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989072:0:17072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989090:0:17072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989096:0:17072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350037.989100:0:17072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989107:0:17072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989118:0:17072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350037.989157:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783350037.989187:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+16:3646:x1869977659550080:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350037.989193:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783350037.989215:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659550080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350037.989333:0:18240:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350037.989341:0:18240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350037.989348:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e3385 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350038.214320:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783350039.115313:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783350039.241913:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783350039.300324:0:17084:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783350039.300331:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea348c55800 from 13 10000000:01000000:0.0:1783350039.300352:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783350039.300394:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350039.300406:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350039.300417:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350039.300613:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783350039.300691:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350039.300736:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea24393a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783350039.300749:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659550208 00000100:00100000:3.0:1783350039.300759:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659550208 00000100:00100000:3.0:1783350039.300825:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783350039.300834:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+16:17084:x1869977659550208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350039.301684:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350039.301768:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3393 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e338c expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350039.301797:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e338c expref: 17 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350039.301807:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e338c expref: 17 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350039.301816:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c6c00, rc 0) 00000100:00100000:2.0:1783350039.301885:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17084:x1869977659550208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1051us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350039.301892:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783350039.302244:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350039.302261:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350039.302272:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350039.302363:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350039.302395:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350039.302437:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783350039.302675:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659550336 00000100:00100000:0.0:1783350039.302680:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659550336 00000100:00100000:0.0:1783350039.302724:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783350039.302732:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17084:x1869977659550336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783350039.302869:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17084:x1869977659550336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350039.302876:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783350039.303552:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350039.303588:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783350039.303639:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350039.303659:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350039.303695:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659550464 00000100:00100000:2.0:1783350039.303702:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659550464 00000100:00100000:2.0:1783350039.303753:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783350039.303768:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17084:x1869977659550464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783350039.303852:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17084:x1869977659550464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350039.303915:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783350039.305125:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783350039.307595:0:18310:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783350039.308369:0:17084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783350039.308398:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783350039.308409:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350039.308619:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350039.308632:0:17084:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783350039.308635:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea37f5b5800 from 13 10000000:01000000:1.0:1783350039.308638:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783350039.308827:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350039.308837:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350039.308848:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350039.308873:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783350039.308958:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350039.309118:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b58bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783350039.311305:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659550592 00000100:00100000:0.0:1783350039.311318:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659550592 00000100:00100000:1.0:1783350039.311479:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783350039.311500:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+17:17084:x1869977659550592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350039.311770:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350039.311789:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e33a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e339a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350039.311817:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e33a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e339a expref: 18 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350039.311827:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e33a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e339a expref: 18 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350039.311836:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d200, rc 0) 00000100:00100000:1.0:1783350039.311968:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17084:x1869977659550592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 479us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350039.311983:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783350039.312007:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350039.312028:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350039.312038:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350039.312107:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350039.312163:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350039.312194:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19840 going to sleep for 11 seconds 00000100:00100000:0.0:1783350039.312330:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659550720 00000100:00100000:0.0:1783350039.312336:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659550720 00000100:00100000:0.0:1783350039.312381:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783350039.312390:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17084:x1869977659550720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783350039.312536:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17084:x1869977659550720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350039.312544:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783350039.312595:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783350039.312622:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783350039.312657:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350039.312688:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19840 going to sleep for 11 seconds 00000100:00100000:0.0:1783350039.313177:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659550848 00000100:00100000:0.0:1783350039.313183:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659550848 00000100:00100000:0.0:1783350039.313228:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783350039.313236:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17084:x1869977659550848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783350039.313361:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:17084:x1869977659550848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350039.313368:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783350039.313530:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659550848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783350039.314481:0:18313:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783350039.314657:0:17084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783350039.314677:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783350039.314688:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350039.314699:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350040.260352:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350041.287810:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350042.311900:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350042.500410:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783350042.500431:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659550976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783350042.500487:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783350042.500499:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659551104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350042.500517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350042.503239:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350042.504263:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350032/real 1783350032] req@ffff8ea243083b80 x1869977659545088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350042.504286:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea243083b80 x1869977659545088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350042.504298:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350032/real 1783350032] req@ffff8ea243083480 x1869977659544960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350042.504309:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea243083480 x1869977659544960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350042.504319:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350027/real 1783350027] req@ffff8ea244525c00 x1869977659543168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350042.504336:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea244525c00 x1869977659543168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350042.504357:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350027/real 1783350027] req@ffff8ea244527100 x1869977659542912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350042.504372:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea244527100 x1869977659542912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783350042.504391:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350042.504403:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783350042.504407:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659545088:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783350042.504414:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350042.504418:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783350042.504421:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659544960:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783350042.504426:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350042.504430:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783350042.504433:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659543168:0@lo:8:kworker.0 00000100:00080000:2.0:1783350042.504438:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d970000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350042.504441:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783350042.504444:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659542912:0@lo:8:kworker.0 00000100:00100000:2.0:1783350042.504500:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659550976 00000100:00100000:2.0:1783350042.504508:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659550976 00000100:00100000:2.0:1783350042.504540:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659551104 00000100:00100000:2.0:1783350042.504542:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659551104 00000100:00100000:2.0:1783350042.504553:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783350042.504559:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659550976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350042.504590:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783350042.504648:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659550976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (4134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350042.504653:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783350042.504666:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783350042.504670:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659551104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783350042.504681:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350042.504713:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1869977659551104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 41us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350042.504718:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783350042.504783:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659551104:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1783350042.504790:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350042.504795:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783350042.504798:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350042.504802:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:2.0:1783350042.504807:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1783350042.504809:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659551232:0@lo:400:kworker.0 00000100:00080000:2.0:1783350042.504813:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ea243259000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350042.504834:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243083b80 x1869977659551360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783350042.504846:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350042.504849:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783350042.504850:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea36d970000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783350042.504857:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350042.504888:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659551232 00000100:00100000:0.0:1783350042.504892:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659551232 00000100:00100000:0.0:1783350042.504930:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783350042.504937:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:3649:x1869977659551232:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783350042.504950:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:2.0:1783350042.504955:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783350042.504959:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ea36d970000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350042.504973:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243082680 x1869977659551488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783350042.504991:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:3649:x1869977659551232:12345-0@lo:400:kworker.0 Request processed in 52us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350042.504999:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1783350042.505007:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350042.505010:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783350042.505012:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea24271f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350042.505015:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1783350042.505017:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783350042.505020:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ea24271f000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350042.505029:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243082a00 x1869977659551744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783350042.505041:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659551232:0@lo:400:kworker.0 00000100:00080000:2.0:1783350042.505044:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350042.505048:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783350042.505049:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350042.505052:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1783350042.505053:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783350042.505056:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea349fe1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350042.505063:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243081c00 x1869977659551872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783350042.505092:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659551360:0@lo:8:kworker.0 00000100:00100000:1.0:1783350042.505118:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659552000:0@lo:400:kworker.0 00000400:00000100:2.0:1783350042.505119:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659551360 offset 0 length 520: 4 00000100:00100000:2.0:1783350042.505157:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659551488:0@lo:8:kworker.0 00000400:00000100:2.0:1783350042.505213:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659551488 offset 0 length 520: 4 00000100:00100000:2.0:1783350042.505233:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659551744:0@lo:8:kworker.0 00000400:00000100:2.0:1783350042.505262:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659551744 offset 0 length 520: 4 00000100:00100000:2.0:1783350042.505272:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659551872:0@lo:8:kworker.0 00000400:00000100:2.0:1783350042.505307:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977659551872 offset 0 length 520: 4 00000100:00100000:2.0:1783350042.505339:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659550976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350042.505348:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659551616:0@lo:400:kworker.0 00000100:00100000:2.0:1783350042.505365:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350042.505434:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659551616 00000100:00100000:0.0:1783350042.505439:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659551616 00000100:00100000:0.0:1783350042.505487:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783350042.505494:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659551616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350042.505535:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659551616:12345-0@lo:400:kworker.0 Request processed in 42us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350042.505541:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783350042.505580:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea243081f80 x1869977659551616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350042.505591:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659551616:0@lo:400:kworker.0 00000100:00100000:1.0:1783350042.511432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350042.511718:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659552000 00000100:00100000:2.0:1783350042.511727:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659552000 00000100:00100000:2.0:1783350042.511790:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350042.511800:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659552000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350042.511870:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659552000:12345-0@lo:400:kworker.0 Request processed in 72us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350042.511877:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783350042.512061:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea243080700 x1869977659552000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350042.512076:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659552000:0@lo:400:kworker.0 00000001:00100000:3.0:1783350043.020381:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783350043.332489:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783350043.831193:0:18589:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783350043.831196:0:18589:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783350043.831198:0:18589:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783350043.831302:0:18589:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ea347517800 00000020:01000004:2.0:1783350043.831317:0:18589:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783350043.831329:0:18589:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783350043.831341:0:18589:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ea349f899c0) 00000020:00000080:2.0:1783350043.831357:0:18589:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783350043.906017:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783350043.911844:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783350043.912758:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783350043.913120:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783350043.913922:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783350043.914297:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783350043.916321:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1783350043.921748:0:18589:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783350043.921951:0:18589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783350043.921963:0:18589:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783350043.921975:0:18589:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd05e6ae1590e33af 00000020:01000004:3.0:1783350043.921982:0:18589:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783350043.922002:0:18589:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783350043.922005:0:18589:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783350043.922011:0:18589:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783350043.922016:0:18589:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783350043.922031:0:18589:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ea37f458000) 00000020:00000080:3.0:1783350043.922043:0:18589:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1783350043.923094:0:18589:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783350043.923251:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783350043.923257:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783350043.931574:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783350043.931589:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783350043.933574:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783350043.933586:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783350043.940189:0:18589:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783350043.940361:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783350043.940368:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783350043.941777:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783350043.941787:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783350043.977615:0:18589:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783350043.977930:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783350043.977938:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783350043.980192:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783350043.980207:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783350043.982491:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783350043.982511:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783350043.987496:0:18589:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783350043.987669:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783350043.987675:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783350043.988524:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783350043.988533:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783350044.015617:0:18589:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783350044.015794:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783350044.015801:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783350044.019041:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783350044.019059:0:18589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783350044.022005:0:18589:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783350044.022034:0:18589:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783350044.022040:0:18589:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783350044.048758:0:18589:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783350044.048866:0:18589:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.150@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1783350044.048870:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783350044.048872:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783350044.048874:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350044.048875:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350044.048876:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350044.048877:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350044.048879:0:18589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783350044.048881:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350044.048883:0:18589:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783350044.048886:0:18589:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1783350044.048888:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783350044.048890:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783350044.048891:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350044.048892:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350044.048893:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350044.048894:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350044.048895:0:18589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783350044.048896:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350044.048897:0:18589:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783350044.048922:0:18589:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783350044.049517:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552128:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783350044.049602:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350044.049651:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f79180 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.049747:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659552128 00000100:00100000:1.0:1783350044.049755:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659552128 00000100:00100000:1.0:1783350044.049805:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783350044.049824:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:18589:x1869977659552128:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783350044.049862:0:17081:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783350044.049865:0:17081:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783350044.049870:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783350044.052584:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:18589:x1869977659552128:12345-0@lo:253:mount.lustre.0 Request processed in 2752us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.052597:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783350044.053386:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552128:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783350044.053404:0:18589:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783350044.053407:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783350044.053409:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783350044.053410:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350044.053411:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350044.053426:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350044.053427:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350044.053429:0:18589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783350044.053431:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350044.053432:0:18589:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783350044.053554:0:18589:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea347517800 from lustre-OST0000 10000000:01000000:2.0:1783350044.053588:0:18589:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783350044.053593:0:18589:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783350044.053599:0:18589:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ea243518000 local copy 00010000:00010000:2.0:1783350044.053608:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350044.053706:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350044.053750:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.053806:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.053839:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659552256 00000100:00100000:1.0:1783350044.053844:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659552256 00000100:00100000:1.0:1783350044.053876:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783350044.053884:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:18589:x1869977659552256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350044.053956:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:18589:x1869977659552256:12345-0@lo:501:mount.lustre.0 Request processed in 72us (204us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783350044.053963:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783350044.053982:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552256:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783350044.053997:0:18589:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783350044.054012:0:18589:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783350044.054017:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.054024:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350044.054043:0:18589:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea347517800 10000000:01000000:2.0:1783350044.054046:0:18589:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783350044.054049:0:18589:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783350044.054051:0:18589:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783350044.054053:0:18589:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783350044.054055:0:18589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783350044.054072:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.054077:0:18589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.054090:0:18589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350044.054099:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783350044.054116:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.054394:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.054482:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659552384 00000100:00100000:1.0:1783350044.054487:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659552384 00000100:00100000:1.0:1783350044.054519:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783350044.054525:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+18:18589:x1869977659552384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350044.054533:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350044.054546:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e33c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e33bd expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.054564:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e33c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e33bd expref: 19 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.054573:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8cc00/0xd05e6ae1590e33c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e33bd expref: 19 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.054592:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8cc00, rc 0) 00000100:00100000:1.0:1783350044.054698:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:18589:x1869977659552384:12345-0@lo:101:mount.lustre.0 Request processed in 172us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.054705:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783350044.054805:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350044.054815:0:18589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.054820:0:18589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783350044.055925:0:18589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1783350044.056580:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783350044.058368:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1783350044.058430:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1783350044.058442:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1783350044.058450:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1783350044.058481:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1783350044.058496:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1783350044.058520:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1783350044.058525:0:18589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1783350044.058641:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350044.058732:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.058776:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.058878:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659552512 00000100:00100000:1.0:1783350044.058885:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659552512 00000100:00100000:1.0:1783350044.058928:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783350044.058938:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34460b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:18589:x1869977659552512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350044.059087:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34460b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:18589:x1869977659552512:12345-0@lo:501:mount.lustre.0 Request processed in 150us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.059092:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783350044.059169:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350044.059215:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350044.059255:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.059311:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.059340:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659552640 00000100:00100000:1.0:1783350044.059344:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659552640 00000100:00100000:1.0:1783350044.059373:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783350044.059379:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea344608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:18589:x1869977659552640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350044.059892:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea344608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:18589:x1869977659552640:12345-0@lo:503:mount.lustre.0 Request processed in 512us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.059897:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783350044.059947:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552640:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783350044.060300:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783350044.060364:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350044.060403:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.060478:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.060510:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659552768 00000100:00100000:1.0:1783350044.060515:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659552768 00000100:00100000:1.0:1783350044.060550:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783350044.060558:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:18589:x1869977659552768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350044.061002:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:18589:x1869977659552768:12345-0@lo:502:mount.lustre.0 Request processed in 443us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.061009:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783350044.063082:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350044.063316:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783350044.063345:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783350044.063358:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783350044.063372:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783350044.063385:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783350044.063396:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783350044.063409:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783350044.063421:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783350044.063449:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1783350044.063478:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1783350044.063491:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1783350044.063503:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1783350044.063534:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350044.063595:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.063635:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.063650:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659552896 00000100:00100000:1.0:1783350044.063657:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659552896 00000100:00100000:1.0:1783350044.063710:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783350044.063719:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:18589:x1869977659552896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350044.063820:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:18589:x1869977659552896:12345-0@lo:502:mount.lustre.0 Request processed in 101us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.063826:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783350044.063945:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659552896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350044.063979:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1783350044.063990:0:18589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1783350044.064873:0:18606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783350044.064882:0:18606:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1783350044.064887:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350044.064889:0:18606:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783350044.064895:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783350044.064909:0:18606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ea241dc8000) 00000020:00000080:1.0:1783350044.064930:0:18606:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783350044.064934:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783350044.064992:0:18606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea347517800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783350044.064999:0:18606:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783350044.065004:0:18606:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd05e6ae1590e33d2 00010000:00010000:1.0:1783350044.069821:0:18606:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1783350044.070404:0:18606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1783350044.071666:0:18606:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1783350044.072815:0:18606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783350044.072825:0:18606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350044.072831:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350044.072833:0:18606:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783350044.072836:0:18606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783350044.072839:0:18606:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1783350044.072841:0:18606:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783350044.072842:0:18606:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783350044.072843:0:18606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783350044.072846:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350044.072851:0:18606:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783350044.072854:0:18606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350044.072857:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350044.072858:0:18606:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783350044.072861:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783350044.072863:0:18606:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783350044.072865:0:18606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350044.072867:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350044.072868:0:18606:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783350044.072870:0:18606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783350044.072872:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350044.072873:0:18606:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783350044.072876:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783350044.072899:0:18606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783350044.072902:0:18606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783350044.072903:0:18606:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783350044.072907:0:18606:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1783350044.073123:0:18589:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1783350044.073385:0:18589:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783350044.073409:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.073421:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7a00/0xd05e6ae1590e33bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33c4 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350044.073430:0:18589:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea347517800 from 1 10000000:01000000:2.0:1783350044.073432:0:18589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783350044.073475:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.073484:0:18589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.073495:0:18589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350044.073519:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783350044.073583:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.073659:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.073800:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659553024 00000100:00100000:1.0:1783350044.073808:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659553024 00000100:00100000:1.0:1783350044.073887:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783350044.073895:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:18589:x1869977659553024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350044.073909:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350044.073922:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e33e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e33d9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.073946:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e33e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e33d9 expref: 20 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.073957:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e33e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e33d9 expref: 20 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.073965:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8dc00, rc 0) 00000100:00100000:1.0:1783350044.074011:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659553024:12345-0@lo:101:mount.lustre.0 Request processed in 116us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.074018:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783350044.074082:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350044.074097:0:18589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.074105:0:18589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783350044.074878:0:18589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783350044.075051:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783350044.075201:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783350044.075226:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783350044.075363:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783350044.075369:0:18589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783350044.075426:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350044.075486:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.075520:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.075620:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659553152 00000100:00100000:1.0:1783350044.075625:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659553152 00000100:00100000:1.0:1783350044.075773:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783350044.075782:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659553152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350044.075881:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659553152:12345-0@lo:501:mount.lustre.0 Request processed in 99us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.075888:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783350044.075949:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350044.075978:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350044.076013:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.076082:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc480 going to sleep for 11 seconds 00000100:00100000:3.0:1783350044.076126:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659553280 00000100:00100000:3.0:1783350044.076131:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659553280 00000100:00100000:3.0:1783350044.076173:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783350044.076179:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659553280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783350044.076265:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659553280:12345-0@lo:503:mount.lustre.0 Request processed in 86us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350044.076271:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783350044.076473:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553280:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783350044.076809:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783350044.076864:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350044.076899:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.076926:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.076937:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659553408 00000100:00100000:1.0:1783350044.076943:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659553408 00000100:00100000:1.0:1783350044.076982:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783350044.076992:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659553408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350044.077080:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659553408:12345-0@lo:502:mount.lustre.0 Request processed in 90us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.077087:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783350044.077104:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350044.077358:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783350044.077376:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783350044.077383:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783350044.077399:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783350044.077407:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783350044.077414:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783350044.077426:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783350044.077433:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1783350044.077439:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1783350044.077446:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1783350044.077469:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1783350044.077485:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350044.077508:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.077556:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc000 going to sleep for 11 seconds 00000100:00100000:3.0:1783350044.077579:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659553536 00000100:00100000:3.0:1783350044.077582:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659553536 00000100:00100000:3.0:1783350044.077623:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783350044.077628:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659553536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350044.077687:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659553536:12345-0@lo:502:mount.lustre.0 Request processed in 58us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350044.077694:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783350044.077713:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350044.077754:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1783350044.077762:0:18589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1783350044.078168:0:18610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350044.078176:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350044.078178:0:18610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783350044.078185:0:18610:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea347517800 00000020:00000080:2.0:1783350044.078188:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783350044.078195:0:18610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350044.078198:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350044.078199:0:18610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783350044.078202:0:18610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350044.078204:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350044.078205:0:18610:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783350044.078208:0:18610:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea347517800 00000020:00000080:2.0:1783350044.078210:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783350044.078326:0:18610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350044.078330:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350044.078332:0:18610:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783350044.078335:0:18610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350044.078337:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350044.078339:0:18610:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783350044.078342:0:18610:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea347517800 00000020:00000080:2.0:1783350044.078345:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783350044.078366:0:18610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350044.078369:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350044.078371:0:18610:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783350044.078373:0:18610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783350044.078381:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350044.078382:0:18610:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783350044.078386:0:18610:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea347517800 00000020:00000080:2.0:1783350044.078387:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783350044.078408:0:18610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783350044.078411:0:18610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783350044.078412:0:18610:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783350044.078415:0:18610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1783350044.078555:0:18589:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783350044.078575:0:18589:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783350044.078624:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350044.078636:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350044.078680:0:18589:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783350044.078683:0:18589:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea347517800 10000000:01000000:3.0:1783350044.078686:0:18589:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea347517800 10000000:01000000:3.0:1783350044.078694:0:18589:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783350044.078699:0:18589:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea347517800 from 1 10000000:01000000:3.0:1783350044.078702:0:18589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783350044.078726:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350044.078734:0:18589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350044.078743:0:18589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350044.078760:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350044.078800:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350044.078825:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659553664 00000100:00100000:1.0:1783350044.078832:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659553664 00000100:00100000:3.0:1783350044.078833:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2410e7180 going to sleep for 11 seconds 00000100:00100000:1.0:1783350044.078864:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783350044.078874:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659553664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350044.078884:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350044.078897:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8d800/0xd05e6ae1590e33ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e33e7 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.078918:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8d800/0xd05e6ae1590e33ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e33e7 expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.078941:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8d800/0xd05e6ae1590e33ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e33e7 expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.078950:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d800, rc 0) 00000100:00100000:1.0:1783350044.078992:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659553664:12345-0@lo:101:mount.lustre.0 Request processed in 119us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.078998:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783350044.079026:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350044.079041:0:18589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350044.079050:0:18589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783350044.082307:0:18589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1783350044.082615:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783350044.082830:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783350044.082862:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783350044.082885:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783350044.082901:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783350044.082929:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783350044.082946:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783350044.082973:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783350044.082990:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783350044.083006:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783350044.083023:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783350044.083044:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783350044.083064:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783350044.083088:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783350044.083103:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783350044.083121:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783350044.083698:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783350044.083726:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783350044.083743:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783350044.083760:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783350044.083778:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783350044.083807:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783350044.083825:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783350044.083845:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783350044.083866:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783350044.083886:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1783350044.083905:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1783350044.083923:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1783350044.083940:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1783350044.083958:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1783350044.083978:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1783350044.083996:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1783350044.084020:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1783350044.084041:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1783350044.084062:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1783350044.084084:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1783350044.084102:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1783350044.084203:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1783350044.084233:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1783350044.084245:0:18589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1783350044.084345:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350044.084410:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350044.084469:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2410e7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783350044.084489:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659553792 00000100:00100000:0.0:1783350044.084498:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659553792 00000100:00100000:0.0:1783350044.084554:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783350044.084563:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659553792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350044.084683:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659553792:12345-0@lo:501:mount.lustre.0 Request processed in 121us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350044.084690:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783350044.084736:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350044.084768:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783350044.084803:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350044.084825:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21540 going to sleep for 11 seconds 00000100:00100000:3.0:1783350044.084892:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659553920 00000100:00100000:3.0:1783350044.084897:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659553920 00000100:00100000:3.0:1783350044.084926:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783350044.084933:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659553920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783350044.084995:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659553920:12345-0@lo:503:mount.lustre.0 Request processed in 62us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350044.085001:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783350044.085073:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659553920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783350044.085416:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783350044.085480:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659554048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350044.085512:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350044.085540:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21540 going to sleep for 11 seconds 00000100:00100000:3.0:1783350044.085591:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659554048 00000100:00100000:3.0:1783350044.085594:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659554048 00000100:00100000:3.0:1783350044.085692:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783350044.085700:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659554048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350044.085768:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659554048:12345-0@lo:502:mount.lustre.0 Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350044.085775:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783350044.085844:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659554048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350044.086002:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783350044.086025:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783350044.086039:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783350044.086052:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783350044.086064:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783350044.086077:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783350044.086089:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783350044.086103:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783350044.086116:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783350044.086129:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783350044.086163:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783350044.086178:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783350044.086193:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783350044.086215:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783350044.086229:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783350044.086243:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783350044.086255:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783350044.086268:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783350044.086281:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783350044.086294:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783350044.086307:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783350044.086321:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783350044.086348:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783350044.086364:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783350044.086377:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1783350044.086390:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1783350044.086402:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1783350044.086416:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1783350044.086430:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1783350044.086443:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1783350044.086470:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1783350044.086484:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1783350044.086498:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1783350044.086511:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1783350044.086524:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1783350044.086538:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1783350044.086551:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1783350044.086565:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1783350044.086588:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1783350044.086603:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1783350044.086616:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1783350044.086629:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1783350044.086641:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1783350044.086655:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1783350044.086669:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1783350044.086681:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1783350044.086702:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1783350044.086716:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1783350044.086751:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659554176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350044.086794:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350044.086821:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659554176 00000100:00100000:0.0:1783350044.086826:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659554176 00000100:00100000:0.0:1783350044.086848:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783350044.086855:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659554176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350044.086930:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659554176:12345-0@lo:502:mount.lustre.0 Request processed in 75us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350044.086936:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783350044.086975:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21540 going to sleep for 11 seconds 00000100:00100000:0.0:1783350044.086989:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659554176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350044.087101:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1783350044.087120:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1783350044.087159:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659554304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350044.087188:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350044.087206:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659554304 00000100:00100000:0.0:1783350044.087210:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659554304 00000100:00100000:0.0:1783350044.087225:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783350044.087230:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659554304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350044.087281:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659554304:12345-0@lo:502:mount.lustre.0 Request processed in 50us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350044.087287:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783350044.087314:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21540 going to sleep for 11 seconds 00000100:00100000:0.0:1783350044.087324:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659554304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783350044.087359:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1783350044.087366:0:18589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783350044.089022:0:18615:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783350044.089040:0:18615:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ea370df8000) 00000020:00000080:1.0:1783350044.089062:0:18615:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1783350044.090485:0:18615:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea347517800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783350044.090492:0:18615:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea347517800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783350044.090494:0:18615:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea347517800 3 00010000:00080000:1.0:1783350044.090528:0:18615:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea347503800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783350044.092355:0:18615:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1783350044.092463:0:18615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783350044.092507:0:18615:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783350044.092529:0:18615:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd05e6ae1590e33fc 00000100:00080000:1.0:1783350044.092538:0:18615:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783350044.092543:0:18615:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ea347503800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350044.092573:0:18615:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea379139180 x1869977659554432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350044.092601:0:18615:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783350044.092647:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350044.092651:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350044.092654:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350044.092662:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350044.092689:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350044.092693:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783350044.092695:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783350044.092698:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783350044.092731:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659554944:0@lo:400:kworker.0 00000100:00100000:2.0:1783350044.092763:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659554432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783350044.092797:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.092806:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659554560:0@lo:400:kworker.0 00000100:00100000:1.0:1783350044.092829:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783350044.092830:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350044.092834:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659554816:0@lo:400:kworker.0 00000100:00100000:2.0:1783350044.092848:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783350044.092853:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659554688:0@lo:400:kworker.0 00000100:00100000:1.0:1783350044.092854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.092872:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.092906:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659554560 00000100:00100000:2.0:1783350044.092912:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659554560 00000100:00100000:2.0:1783350044.092943:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659554816 00000100:00100000:2.0:1783350044.092946:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659554816 00000100:00100000:2.0:1783350044.092957:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783350044.092962:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659554560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350044.093002:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659554560:12345-0@lo:400:kworker.0 Request processed in 40us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350044.093006:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783350044.093016:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783350044.093020:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659554816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350044.093046:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659554816:12345-0@lo:400:kworker.0 Request processed in 25us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350044.093051:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783350044.093078:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659554944 00000100:00100000:2.0:1783350044.093081:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659554944 00000100:00100000:1.0:1783350044.093096:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659554816:0@lo:400:kworker.0 00000100:00100000:2.0:1783350044.093105:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659554688 00000100:00100000:2.0:1783350044.093107:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659554688 00000100:00100000:0.0:1783350044.093124:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783350044.093132:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659554944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350044.093186:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659554944:12345-0@lo:400:kworker.0 Request processed in 56us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350044.093624:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350044.093632:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783350044.093636:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659554688:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1783350044.093763:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea37913a680 x1869977659554944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350044.093775:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659554944:0@lo:400:kworker.0 00000100:00100000:2.0:1783350044.094518:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659554688:12345-0@lo:400:kworker.0 Request processed in 44us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350044.094527:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783350044.094577:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783350044.094647:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea379138000 x1869977659554688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350044.094658:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659554688:0@lo:400:kworker.0 00000100:00100000:2.0:1783350044.094670:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659554560:0@lo:400:kworker.0 00000020:01000004:2.0:1783350044.094782:0:18615:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783350044.094797:0:18615:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ea349f8cd40) 00000020:00000080:2.0:1783350044.094816:0:18615:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1783350044.094984:0:18615:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea347517800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783350044.094989:0:18615:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea347517800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783350044.094991:0:18615:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea347517800 3 00010000:00080000:2.0:1783350044.095019:0:18615:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea34778f000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.150@tcp at head 00000100:00100000:1.0:1783350044.095837:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659554432 00000100:00100000:1.0:1783350044.095846:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659554432 00000100:00100000:1.0:1783350044.095877:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783350044.095884:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869977659554432:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783350044.095908:0:17087:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:1.0:1783350044.095940:0:17087:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd05e6ae1590e340a 00000004:00100000:1.0:1783350044.095954:0:17087:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783350044.095982:0:17087:0:(import.c:65:import_set_state_nolock()) ffff8ea2437ab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783350044.096048:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869977659554432:12345-0@lo:38:llog_process_th.0 Request processed in 162us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350044.096055:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783350044.096092:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea379139180 x1869977659554432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350044.096113:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783350044.096121:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1783350044.096128:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783350044.096133:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783350044.096153:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea347503800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783350044.096161:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869977659554432:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1783350044.097822:0:18615:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1783350044.097892:0:18615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1783350044.097932:0:18615:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783350044.097940:0:18615:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd05e6ae1590e3411 00000100:00080000:2.0:1783350044.097947:0:18615:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783350044.097951:0:18615:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ea34778f000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350044.097976:0:18615:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243082d80 x1869977659555072/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783350044.098001:0:18615:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783350044.098026:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350044.098030:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783350044.098033:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1783350044.098033:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869977659555072:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1783350044.098036:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783350044.098040:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350044.098043:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783350044.098045:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350044.098048:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783350044.098101:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1783350044.098231:0:18615:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1783350044.098299:0:18589:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783350044.098335:0:18589:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783350044.098353:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.098364:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea340031200/0xd05e6ae1590e33e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e33ee expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783350044.098480:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783350044.098483:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783350044.098484:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350044.098485:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350044.098487:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350044.098488:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350044.098490:0:18589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783350044.098492:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350044.098493:0:18589:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783350044.098497:0:18589:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1783350044.098499:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783350044.098500:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783350044.098506:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350044.098507:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350044.098508:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350044.098509:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350044.098510:0:18589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783350044.098511:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350044.098511:0:18589:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783350044.098526:0:18589:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783350044.098538:0:18589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659555200:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783350044.098559:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659555072 00000100:00100000:3.0:1783350044.098567:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659555072 00000100:00100000:0.0:1783350044.098577:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350044.098604:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659555200 00000100:00100000:3.0:1783350044.098605:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783350044.098610:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659555200 00000100:00100000:3.0:1783350044.098614:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869977659555072:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783350044.098634:0:17088:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000100:00100000:0.0:1783350044.098645:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783350044.098653:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:18589:x1869977659555200:12345-0@lo:253:mount.lustre.0 00000020:00000080:3.0:1783350044.098660:0:17088:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd05e6ae1590e3418 00000004:00100000:3.0:1783350044.098671:0:17088:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 20000000:01000000:0.0:1783350044.098676:0:17082:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783350044.098690:0:17082:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1783350044.098703:0:17088:0:(import.c:65:import_set_state_nolock()) ffff8ea243732000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783350044.098745:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869977659555072:12345-0@lo:38:llog_process_th.0 Request processed in 131us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350044.098759:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783350044.098779:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ea243082d80 x1869977659555072/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350044.098790:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783350044.098801:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783350044.098807:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783350044.098811:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783350044.098813:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea34778f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783350044.098814:0:18589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783350044.098822:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869977659555072:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1783350044.100799:0:17082:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783350044.100809:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783350044.100887:0:17103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783350044.100892:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783350044.100913:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.100944:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3362 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.100954:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e3377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3370 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.100962:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.101009:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e3377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3370 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.101021:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e3377 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3370 expref: 21 pid: 17079 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350044.101033:0:17103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659555328:0@lo:104: 00000100:00100000:0.0:1783350044.101081:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783350044.101115:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3362 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.101120:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3362 expref: 21 pid: 17079 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350044.101126:0:17103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659555456:0@lo:104: 00000100:00100000:2.0:1783350044.101183:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659555328 00000100:00100000:2.0:1783350044.101188:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659555328 00000100:00100000:2.0:1783350044.101219:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350044.101226:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:17103:x1869977659555328:12345-0@lo:104: 00010000:00010000:2.0:1783350044.101245:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101359:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783350044.101366:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:17103:x1869977659555328:12345-0@lo:104: Request processed in 140us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350044.101372:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1783350044.101379:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350044.101387:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.101396:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b400 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:1.0:1783350044.101401:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.101410:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783350044.101418:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350044.101425:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783350044.101484:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350044.101491:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783350044.101502:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783350044.101528:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350044.101528:0:17103:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783350044.101530:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659555584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350044.101541:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea24364b400/0xd05e6ae1590e3370 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3377 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350044.101548:0:17103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659555328:0@lo:104: 00010000:00010000:1.0:1783350044.101554:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350044.101558:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350044.101562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783350044.101563:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350044.101585:0:17071:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783350044.101594:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659555456 00000100:00100000:2.0:1783350044.101596:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659555584 00000100:00100000:0.0:1783350044.101597:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659555456 00000100:00100000:2.0:1783350044.101598:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659555584 00010000:00010000:2.0:1783350044.101611:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e3377 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3370 expref: 22 pid: 17079 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350044.101627:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783350044.101628:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783350044.101634:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:3648:x1869977659555584:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350044.101634:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37df07450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:17103:x1869977659555456:12345-0@lo:104: 00010000:00010000:0.0:1783350044.101641:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101643:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350044.101647:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e3377 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3370 expref: 22 pid: 17079 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101656:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e3377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3370 expref: 22 pid: 17079 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101668:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e3377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3370 expref: 22 pid: 17079 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.101671:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783350044.101681:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37df07450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:17103:x1869977659555456:12345-0@lo:104: Request processed in 48us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350044.101688:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783350044.101724:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350044.101737:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783350044.101738:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.101744:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350044.101747:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.101754:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350044.101761:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350044.101762:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:3648:x1869977659555584:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (202us total) trans 0 rc 0/0 10000000:01000000:0.0:1783350044.101767:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783350044.101784:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350044.101787:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1783350044.101789:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350044.101797:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.101804:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea24364b800/0xd05e6ae1590e3362 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3369 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350044.101813:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659555584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350044.101815:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350044.101817:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350044.101818:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350044.101825:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783350044.101831:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659555712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783350044.101852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350044.101875:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659555712 00000100:00100000:0.0:1783350044.101876:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:18589:x1869977659555200:12345-0@lo:253:mount.lustre.0 Request processed in 3224us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350044.101878:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659555712 00000100:00100000:0.0:1783350044.101884:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:2.0:1783350044.101888:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3369 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3362 expref: 21 pid: 17079 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350044.101904:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783350044.101909:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243256050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:3648:x1869977659555712:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350044.101911:0:17103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659555456:0@lo:104: 00010000:00010000:2.0:1783350044.101916:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350044.101920:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3362 expref: 20 pid: 17079 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.101925:0:17103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101928:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3362 expref: 20 pid: 17079 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101937:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3362 expref: 20 pid: 17079 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101947:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101955:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783350044.101965:0:17074:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008695573s 00010000:00010000:2.0:1783350044.101975:0:17074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101982:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101989:0:17074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.101995:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.102001:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350044.102004:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.102010:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.102019:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350044.102027:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783350044.102053:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243256050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:3648:x1869977659555712:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350044.102059:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783350044.102059:0:17103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.102066:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350044.102072:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e341f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350044.102097:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659555712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350044.102097:0:18589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:18589:1869977659555200:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783350044.102106:0:18589:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783350044.102109:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783350044.102111:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783350044.102112:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783350044.102113:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783350044.102114:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783350044.102115:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783350044.102117:0:18589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783350044.102119:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783350044.102120:0:18589:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783350044.102130:0:18589:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1783350044.104878:0:18589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1783350044.107000:0:18589:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1783350044.107007:0:18589:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1783350044.107038:0:18589:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783350044.107076:0:18589:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783350044.107097:0:18589:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783350044.107115:0:18589:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783350044.111387:0:18589:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783350044.111600:0:18589:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783350044.356774:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783350044.484908:0:17847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1783350045.032621:0:18669:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783350045.032909:0:18669:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1783350045.265198:0:17084:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783350045.265204:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea348c55800 from 9 10000000:01000000:1.0:1783350045.265208:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783350045.265254:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.265264:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.265274:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350045.265299:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659555840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783350045.265360:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350045.265396:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350045.265505:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659555840 00000100:00100000:1.0:1783350045.265512:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659555840 00000100:00100000:1.0:1783350045.269442:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783350045.269467:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+19:17084:x1869977659555840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350045.269485:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350045.269505:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e342d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3426 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.269531:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e342d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3426 expref: 20 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.272110:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e342d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3426 expref: 20 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.272125:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d000, rc 0) 00000100:00100000:1.0:1783350045.272221:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:17084:x1869977659555840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2759us (6859us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350045.272230:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783350045.272554:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659555840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350045.272587:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350045.272597:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350045.272664:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659555968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783350045.272703:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350045.272740:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1783350045.272980:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659555968 00000100:00100000:1.0:1783350045.272987:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659555968 00000100:00100000:1.0:1783350045.273031:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783350045.273039:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:17084:x1869977659555968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783350045.273059:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783350045.273074:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783350045.273077:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1783350045.273199:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:17084:x1869977659555968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350045.273206:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783350045.273236:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659555968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783350045.273295:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783350045.273303:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.273311:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350045.273321:0:17084:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783350045.273323:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea37f5b5800 from 9 10000000:01000000:1.0:1783350045.273326:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783350045.273346:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.273353:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.273361:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350045.273375:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659556096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783350045.273400:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350045.273419:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350045.273430:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659556096 00000100:00100000:1.0:1783350045.273434:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659556096 00000100:00100000:1.0:1783350045.275164:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783350045.275179:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:17084:x1869977659556096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350045.275193:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350045.275209:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8c000/0xd05e6ae1590e343b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3434 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.275245:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8c000/0xd05e6ae1590e343b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3434 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.275255:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8c000/0xd05e6ae1590e343b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3434 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.275263:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c000, rc 0) 00000100:00100000:1.0:1783350045.275319:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:17084:x1869977659556096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350045.275326:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783350045.293232:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659556096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350045.293257:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350045.293269:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350045.293336:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659556224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783350045.293396:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350045.293429:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2430cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1783350045.293452:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659556224 00000100:00100000:2.0:1783350045.293457:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659556224 00000100:00100000:2.0:1783350045.293494:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783350045.293501:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:17084:x1869977659556224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783350045.293521:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783350045.293535:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783350045.293548:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1783350045.293616:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:17084:x1869977659556224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350045.293627:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783350045.293664:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659556224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783350045.293715:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783350045.293722:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350045.293730:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350045.380749:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350046.404531:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350047.432994:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350047.620355:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783350047.620378:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659556352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350047.620465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350047.620516:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659556352 00000100:00100000:2.0:1783350047.620523:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659556352 00000100:00100000:2.0:1783350047.620583:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783350047.620600:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659556352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350047.620632:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783350047.620950:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659556352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 357us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350047.620958:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783350047.621004:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659556352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783350047.626795:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350047.626817:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659556480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783350047.626890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350047.627705:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659556480 00000100:00100000:2.0:1783350047.627719:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659556480 00000100:00100000:2.0:1783350047.627777:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783350047.627787:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659556480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783350047.627831:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350047.627923:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659556480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350047.627930:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783350047.628199:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659556480:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783350048.452804:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783350049.172490:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783350049.172497:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783350049.172515:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783350049.172518:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783350049.172548:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783350049.172551:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783350049.172553:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783350049.172556:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783350049.172604:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659556736:0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.172670:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350049.172709:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659557248:0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.172738:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350049.172761:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783350049.172767:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659556608:0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.172792:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350049.172813:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659557120:0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.172833:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350049.172857:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659556864:0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.172880:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350049.172894:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659557376:0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.172918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350049.172929:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783350049.172933:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659556992:0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.172952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350049.173011:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659556736 00000100:00100000:0.0:1783350049.173026:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659556736 00000100:00100000:0.0:1783350049.173064:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659556992 00000100:00100000:0.0:1783350049.173067:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659556992 00000100:00100000:0.0:1783350049.173083:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783350049.173091:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659556736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.173165:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659556736:12345-0@lo:400:kworker.0 Request processed in 74us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350049.173173:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783350049.173189:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783350049.173195:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659556992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.173227:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659556992:12345-0@lo:400:kworker.0 Request processed in 32us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350049.173232:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783350049.173250:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659557248 00000100:00100000:0.0:1783350049.173253:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659557248 00000100:00100000:0.0:1783350049.173279:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659557120 00000100:00100000:0.0:1783350049.173282:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659557120 00000100:00100000:0.0:1783350049.173292:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659556864 00000100:00100000:0.0:1783350049.173294:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659556864 00000100:00100000:0.0:1783350049.173303:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659557376 00000100:00100000:0.0:1783350049.173306:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659557376 00000100:00100000:0.0:1783350049.173320:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783350049.173326:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659557248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.173356:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659557248:12345-0@lo:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350049.173362:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783350049.173373:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783350049.173378:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659557120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.173427:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659557120:12345-0@lo:400:kworker.0 Request processed in 49us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350049.173433:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783350049.173445:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783350049.173451:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659556864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.173492:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659556864:12345-0@lo:400:kworker.0 Request processed in 41us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350049.173498:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783350049.173509:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350049.173514:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659557376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.173537:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659557376:12345-0@lo:400:kworker.0 Request processed in 24us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350049.173543:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350049.173559:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659556608 00000100:00100000:0.0:1783350049.173562:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659556608 00000100:00100000:0.0:1783350049.173584:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783350049.173590:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:3649:x1869977659556608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.173617:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:3649:x1869977659556608:12345-0@lo:400:kworker.0 Request processed in 27us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350049.173623:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783350049.173669:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659556608:0@lo:400:kworker.0 00010000:00080000:0.0:1783350049.173681:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea243bae680 x1869977659557120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350049.173691:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659557120:0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.173708:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659556736:0@lo:400:kworker.0 00010000:00080000:0.0:1783350049.173716:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea243bae300 x1869977659557248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350049.173724:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659557248:0@lo:400:kworker.0 00000100:00100000:0.0:1783350049.173752:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659556992:0@lo:400:kworker.0 00010000:00080000:0.0:1783350049.173760:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea243baed80 x1869977659556864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350049.173768:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659556864:0@lo:400:kworker.0 00010000:00080000:0.0:1783350049.173777:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea243bad180 x1869977659557376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350049.173785:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659557376:0@lo:400:kworker.0 00000100:00080000:0.0:1783350049.173809:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350049.173812:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1783350049.417689:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783350049.477370:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350050.501288:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783350051.090981:0:18959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783350051.526512:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783350052.285889:0:19011:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783350052.286542:0:19011:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783350052.549297:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350052.744797:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659557504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783350052.744867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350052.744918:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659557504 00000100:00100000:0.0:1783350052.744925:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659557504 00000100:00100000:0.0:1783350052.744970:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783350052.744979:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659557504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783350052.745026:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783350052.745068:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659557504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350052.745085:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783350052.745126:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659557504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783350052.745772:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783350052.745783:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659557632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350052.745816:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350052.745850:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659557632 00000100:00100000:0.0:1783350052.745855:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659557632 00000100:00100000:0.0:1783350052.745877:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783350052.745883:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659557632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783350052.745903:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350052.745938:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659557632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350052.745944:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783350052.745971:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659557632:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1783350053.186345:0:19061:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783350053.186579:0:19061:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783350053.572261:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783350054.296596:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350054.296612:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350054.296615:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350054.296618:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350054.296633:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350054.296636:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350054.296639:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350054.296642:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783350054.296783:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659557760:0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.296843:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350054.296875:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659558272:0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.296899:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350054.296922:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783350054.296927:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659558144:0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.296948:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350054.296974:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659557888:0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.296994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350054.297020:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659558400:0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.297044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350054.297058:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783350054.297063:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659558016:0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.297082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350054.297094:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659558528:0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.297112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350054.297152:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659557760 00000100:00100000:3.0:1783350054.297160:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659557760 00000100:00100000:3.0:1783350054.297201:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783350054.297208:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:3649:x1869977659557760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.297250:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:3649:x1869977659557760:12345-0@lo:400:kworker.0 Request processed in 43us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350054.297258:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783350054.297284:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659558272 00000100:00100000:3.0:1783350054.297287:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659558272 00000100:00100000:3.0:1783350054.297302:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659558400 00000100:00100000:3.0:1783350054.297304:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659558400 00000100:00100000:3.0:1783350054.297321:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659558016 00000100:00100000:3.0:1783350054.297323:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659558016 00000100:00100000:3.0:1783350054.297332:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659558528 00000100:00100000:3.0:1783350054.297334:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659558528 00000100:00100000:3.0:1783350054.297345:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783350054.297350:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659558272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.297872:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659558272:12345-0@lo:400:kworker.0 Request processed in 520us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350054.297880:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783350054.297896:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783350054.298291:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659558400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.298325:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659558400:12345-0@lo:400:kworker.0 Request processed in 37us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350054.298331:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783350054.298344:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783350054.298349:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659558016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.298639:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659558016:12345-0@lo:400:kworker.0 Request processed in 288us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350054.298646:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783350054.298661:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783350054.298667:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659558528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.298693:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659558528:12345-0@lo:400:kworker.0 Request processed in 27us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350054.298698:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783350054.298716:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659558144 00000100:00100000:3.0:1783350054.298722:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659558144 00000100:00100000:3.0:1783350054.298758:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659557888 00000100:00100000:3.0:1783350054.298762:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659557888 00000100:00100000:3.0:1783350054.298775:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783350054.298780:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659558144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.298808:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659558144:12345-0@lo:400:kworker.0 Request processed in 29us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350054.298814:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783350054.298824:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783350054.298830:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659557888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.298854:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659557888:12345-0@lo:400:kworker.0 Request processed in 25us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350054.298868:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1783350054.299726:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783350054.299733:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783350054.299808:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659558144:0@lo:400:kworker.0 00000100:00100000:3.0:1783350054.299821:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659557760:0@lo:400:kworker.0 00010000:00080000:3.0:1783350054.299834:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cf4d880 x1869977659558272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350054.299845:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659558272:0@lo:400:kworker.0 00010000:00080000:2.0:1783350054.303828:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cf4fb80 x1869977659558016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350054.303846:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659558016:0@lo:400:kworker.0 00010000:00080000:2.0:1783350054.303860:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cf4f800 x1869977659558528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350054.303869:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659558528:0@lo:400:kworker.0 00000100:00100000:2.0:1783350054.303882:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659557888:0@lo:400:kworker.0 00010000:00080000:2.0:1783350054.303893:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cf4ea00 x1869977659558400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350054.303917:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659558400:0@lo:400:kworker.0 00010000:00010000:1.0:1783350054.596562:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783350054.727600:0:17847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783350055.620276:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350056.644319:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350057.361054:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350042/real 1783350042] req@ffff8ea243082a00 x1869977659551744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350057.361087:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea243082a00 x1869977659551744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350057.370820:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350042/real 1783350042] req@ffff8ea243081c00 x1869977659551872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350057.370852:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea243081c00 x1869977659551872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783350057.370875:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350057.370900:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783350057.370921:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659551744:0@lo:8:kworker.0 00000100:00080000:2.0:1783350057.370926:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350057.370931:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783350057.370934:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659551872:0@lo:8:kworker.0 00000100:00080000:3.0:1783350057.371092:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350057.371096:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350057.371099:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350057.371102:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350057.371160:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350057.371164:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783350057.371166:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea24271f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783350057.371171:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 483 00000100:00080000:3.0:1783350057.371175:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783350057.371181:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ea24271f000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350057.371200:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36cf4df80 x1869977659559168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783350057.371233:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350057.371236:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783350057.371238:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783350057.371241:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 483 00000100:00080000:3.0:1783350057.371243:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783350057.371247:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea349fe1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350057.371258:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea36cf4f800 x1869977659559296/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350057.371297:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659559040:0@lo:400:kworker.0 00000100:00100000:3.0:1783350057.371368:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350057.371396:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783350057.371401:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659558912:0@lo:400:kworker.0 00000100:00100000:3.0:1783350057.371424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350057.371440:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659559680:0@lo:400:kworker.0 00000100:00100000:3.0:1783350057.371458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350057.371483:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659559040 00000100:00100000:3.0:1783350057.371490:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659559040 00000100:00100000:3.0:1783350057.371530:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783350057.371539:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659559040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350057.371586:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659559040:12345-0@lo:400:kworker.0 Request processed in 48us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350057.371593:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783350057.371610:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659558912 00000100:00100000:3.0:1783350057.371613:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659558912 00000100:00100000:3.0:1783350057.371637:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659559680 00000100:00100000:3.0:1783350057.371644:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659559680 00000100:00100000:3.0:1783350057.371663:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783350057.371667:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659558912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350057.371692:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659558912:12345-0@lo:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350057.371698:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783350057.371706:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783350057.371712:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659559680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350057.371732:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659559680:12345-0@lo:400:kworker.0 Request processed in 22us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350057.371738:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1783350057.371771:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cf4e680 x1869977659558912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350057.371782:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659558912:0@lo:400:kworker.0 00010000:00080000:3.0:1783350057.371791:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da7480 x1869977659559680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350057.371798:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659559680:0@lo:400:kworker.0 00000100:00100000:3.0:1783350057.371806:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659559040:0@lo:400:kworker.0 00000100:00100000:3.0:1783350057.371825:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659559168:0@lo:8:kworker.0 00000100:00100000:3.0:1783350057.371849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350057.371869:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659559296:0@lo:8:kworker.0 00000100:00100000:3.0:1783350057.371887:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350057.371912:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659559168 00000100:00100000:3.0:1783350057.371915:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659559168 00000100:00100000:3.0:1783350057.371930:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659559296 00000100:00100000:3.0:1783350057.371932:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659559296 00000100:00100000:3.0:1783350057.371939:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783350057.371943:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1869977659559168:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783350057.371964:0:18595:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1783350057.371984:0:18595:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e3442 00002000:00100000:3.0:1783350057.371996:0:18595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ea243734800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1783350057.372000:0:18595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1783350057.372002:0:18595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783350057.372173:0:18595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1783350057.372194:0:18595:0:(import.c:65:import_set_state_nolock()) ffff8ea243736000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783350057.372231:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1869977659559168:12345-0@lo:8:kworker.0 Request processed in 285us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350057.372237:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783350057.372247:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783350057.372252:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1869977659559296:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783350057.372262:0:18595:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783350057.373081:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659558656:0@lo:400:kworker.0 00000100:00100000:0.0:1783350057.373506:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350057.373552:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659559424:0@lo:400:kworker.0 00000100:00100000:0.0:1783350057.373577:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350057.373603:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783350057.373609:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659558784:0@lo:400:kworker.0 00000100:00100000:0.0:1783350057.373629:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350057.373645:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659559552:0@lo:400:kworker.0 00000100:00100000:0.0:1783350057.373660:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350057.373703:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659558784 00000100:00100000:0.0:1783350057.373708:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659558784 00000100:00100000:0.0:1783350057.373741:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783350057.373747:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659558784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350057.373790:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659558784:12345-0@lo:400:kworker.0 Request processed in 42us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350057.373796:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783350057.373816:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659559424 00000100:00100000:0.0:1783350057.373819:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659559424 00000100:00100000:0.0:1783350057.373837:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659559552 00000100:00100000:0.0:1783350057.373839:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659559552 00000100:00100000:0.0:1783350057.373853:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783350057.373857:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659559424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350057.373882:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659559424:12345-0@lo:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350057.373887:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783350057.373896:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783350057.373901:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659559552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350057.373922:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659559552:12345-0@lo:400:kworker.0 Request processed in 21us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350057.373928:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783350057.373963:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659558784:0@lo:400:kworker.0 00010000:00080000:0.0:1783350057.373975:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da7800 x1869977659559552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350057.373984:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659559552:0@lo:400:kworker.0 00010000:00080000:0.0:1783350057.373993:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cf4fb80 x1869977659559424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350057.374007:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659559424:0@lo:400:kworker.0 00010000:00080000:0.0:1783350057.374060:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea36cf4df80 x1869977659559168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783350077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350057.374068:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783350057.374074:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1783350057.374080:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783350057.374085:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783350057.374087:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea24271f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783350057.374099:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783350057.374103:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659559168:0@lo:8:kworker.0 00000100:00100000:2.0:1783350057.374205:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659558656 00000100:00100000:2.0:1783350057.374209:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659558656 00000100:00100000:2.0:1783350057.374246:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783350057.374253:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:3648:x1869977659558656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350057.374289:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:3648:x1869977659558656:12345-0@lo:400:kworker.0 Request processed in 36us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350057.374295:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000004:00080000:2.0:1783350057.374322:0:17829:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783350057.374411:0:17829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 498169273650ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783350057.374416:0:17829:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1783350057.374535:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783350057.374539:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1783350057.375291:0:17830:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783350057.375317:0:17830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17830:1869977659559936:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1783350057.375368:0:17830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350057.375395:0:17830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350057.375420:0:18596:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783350057.375427:0:18596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1783350057.375456:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3648:1869977659558656:0@lo:400:kworker.0 00000100:00100000:1.0:1783350057.375742:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350057.375753:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659559808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783350057.375784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350057.375904:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659559808 00000100:00100000:2.0:1783350057.375910:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659559808 00000100:00100000:2.0:1783350057.375949:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783350057.375958:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869977659559808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783350057.375981:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783350057.376020:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869977659559808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350057.376026:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1783350057.376044:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783350057.376063:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea243bae680 x1869977659559808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783350073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350057.376078:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659559808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783350057.378792:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659559936 00000100:00100000:2.0:1783350057.378805:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659559936 00000100:00100000:0.0:1783350057.384755:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783350057.384772:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17830:x1869977659559936:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1783350057.390219:0:19278:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783350057.390229:0:19278:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1783350057.390331:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17830:x1869977659559936:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5559us (14958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350057.390342:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783350057.390414:0:17830:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea243baf800 x1869977659559936/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783350073 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350057.390430:0:17830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17830:1869977659559936:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1783350057.390443:0:17830:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1783350057.390487:0:17830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17830:1869977659560064:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783350057.390521:0:17830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350057.390552:0:17830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350a216c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350057.390676:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659560064 00000100:00100000:2.0:1783350057.390682:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659560064 00000100:00100000:2.0:1783350057.390729:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783350057.390739:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17830:x1869977659560064:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1783350057.390764:0:18596:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1783350057.390798:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17830:x1869977659560064:12345-0@lo:5:osp-pre-0-1.0 Request processed in 63us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350057.390805:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783350057.390898:0:17830:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea379139880 x1869977659560064/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783350073 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350057.390909:0:17830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17830:1869977659560064:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1783350057.390916:0:17820:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000004:00080000:1.0:1783350057.390919:0:17830:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1783350057.390947:0:17830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17830:1869977659560192:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783350057.390977:0:17830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350057.391000:0:17830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350a216c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350057.391021:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659560192 00000100:00100000:0.0:1783350057.391025:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659560192 00000100:00100000:0.0:1783350057.391061:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783350057.391068:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17830:x1869977659560192:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1783350057.391093:0:19278:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1783350057.400910:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1869977659559296:12345-0@lo:8:kworker.0 Request processed in 28649us (29014us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783350057.400924:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783350057.401043:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350057.401060:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783350057.401065:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659559296:0@lo:8:kworker.0 00000001:00080000:0.0:1783350057.443930:0:18590:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1783350057.443947:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1783350057.444448:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17830:x1869977659560192:12345-0@lo:5:osp-pre-0-1.0 Request processed in 53376us (53466us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783350057.444459:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783350057.447981:0:17830:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea379139880 x1869977659560192/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783350073 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350057.447998:0:17830:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783350057.448005:0:17830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17830:1869977659560192:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783350057.448021:0:17830:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1783350057.448075:0:17830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379139880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17830:1869977659560320:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1783350057.448130:0:17830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350057.448263:0:17830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350a216c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350057.450560:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659560320 00000100:00100000:0.0:1783350057.450588:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659560320 00000100:00100000:0.0:1783350057.450648:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783350057.450658:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17830:x1869977659560320:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1783350057.450760:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17830:x1869977659560320:12345-0@lo:900:osp-pre-0-1.0 Request processed in 103us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350057.450768:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783350057.450951:0:17830:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea379139880 x1869977659560320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783350073 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350057.450967:0:17830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379139880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17830:1869977659560320:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1783350057.668768:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350057.861372:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783350057.861392:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659560448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350057.861456:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350057.861493:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783350057.861506:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659560576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350057.861538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350057.861643:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659560448 00000100:00100000:0.0:1783350057.861651:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659560448 00000100:00100000:3.0:1783350057.861667:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659560576 00000100:00100000:3.0:1783350057.861686:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659560576 00000100:00100000:0.0:1783350057.861709:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783350057.861716:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783350057.861721:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659560448:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783350057.861727:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659560576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783350057.861759:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000004:00000024:0.0:1783350057.861759:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350057.861818:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659560448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350057.861822:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659560576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350057.861895:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659560576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783350057.862320:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783350057.862369:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659560448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783350057.864922:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1783350058.694265:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783350059.652847:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783350059.717344:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783350059.816179:0:19407:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783350059.816183:0:19407:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783350059.816185:0:19407:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783350059.820517:0:19407:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ea34778c000 00000020:01000004:2.0:1783350059.820540:0:19407:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783350059.820556:0:19407:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783350059.820574:0:19407:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ea37b540000) 00000020:00000080:2.0:1783350059.820607:0:19407:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783350059.916840:0:19407:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783350059.925015:0:19407:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1783350059.925371:0:19407:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783350059.926511:0:19407:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1783350059.926940:0:19407:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1783350059.927229:0:19407:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783350059.927750:0:19407:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1783350059.937407:0:19407:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783350059.937645:0:19407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783350059.937659:0:19407:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783350059.937671:0:19407:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd05e6ae1590e3450 00000020:01000004:1.0:1783350059.937678:0:19407:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783350059.937699:0:19407:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783350059.937703:0:19407:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783350059.937709:0:19407:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783350059.937738:0:19407:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1783350059.937742:0:19407:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783350059.956999:0:19407:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783350059.957037:0:19407:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.150@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783350059.957041:0:19407:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783350059.957043:0:19407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783350059.957044:0:19407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350059.957045:0:19407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350059.957046:0:19407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350059.957047:0:19407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350059.957049:0:19407:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783350059.957050:0:19407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350059.957051:0:19407:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783350059.957055:0:19407:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783350059.957057:0:19407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783350059.957059:0:19407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783350059.957060:0:19407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350059.957061:0:19407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350059.957062:0:19407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350059.957063:0:19407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350059.957063:0:19407:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783350059.957064:0:19407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350059.957065:0:19407:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783350059.957100:0:19407:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783350059.957124:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659560704:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783350059.957213:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350059.957267:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2432f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1783350059.957376:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659560704 00000100:00100000:0.0:1783350059.957384:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659560704 00000100:00100000:0.0:1783350059.957441:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783350059.957449:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:19407:x1869977659560704:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783350059.957487:0:17079:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783350059.957491:0:17079:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1783350059.957494:0:17079:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783350059.957804:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:19407:x1869977659560704:12345-0@lo:253:mount.lustre.0 Request processed in 355us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350059.957813:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783350059.957894:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659560704:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783350059.957909:0:19407:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783350059.957912:0:19407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783350059.957913:0:19407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783350059.957914:0:19407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783350059.957915:0:19407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783350059.957916:0:19407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783350059.957917:0:19407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783350059.957919:0:19407:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783350059.957920:0:19407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783350059.957921:0:19407:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783350059.957938:0:19407:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ea34778c000 from lustre-OST0001 10000000:01000000:3.0:1783350059.957960:0:19407:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783350059.957963:0:19407:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783350059.957970:0:19407:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ea243518000 local copy 00010000:00010000:3.0:1783350059.957980:0:19407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350059.958052:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659560832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350059.958081:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350059.958173:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2432f9000 going to sleep for 11 seconds 00000100:00100000:0.0:1783350059.960479:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659560832 00000100:00100000:0.0:1783350059.960494:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659560832 00000100:00100000:0.0:1783350059.960669:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783350059.960680:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:19407:x1869977659560832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350059.960863:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:19407:x1869977659560832:12345-0@lo:501:mount.lustre.0 Request processed in 185us (2780us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783350059.960871:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783350059.962661:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659560832:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783350059.962690:0:19407:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783350059.962727:0:19407:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783350059.962736:0:19407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350059.962745:0:19407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea24364ae00/0xd05e6ae1590e316a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3171 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783350059.962776:0:19407:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ea34778c000 10000000:01000000:3.0:1783350059.962791:0:19407:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783350059.962797:0:19407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783350059.962801:0:19407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783350059.962805:0:19407:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783350059.962807:0:19407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783350059.962837:0:19407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350059.962844:0:19407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350059.962854:0:19407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350059.962871:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659560960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783350059.962947:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350059.963039:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2432f9000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350059.966255:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659560960 00000100:00100000:1.0:1783350059.966271:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659560960 00000100:00100000:1.0:1783350059.966374:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783350059.966394:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:19407:x1869977659560960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350059.966413:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350059.966432:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e345e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3457 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350059.966458:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e345e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3457 expref: 22 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350059.966468:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8d600/0xd05e6ae1590e345e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3457 expref: 22 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350059.966497:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d600, rc 0) 00000100:00100000:1.0:1783350059.966580:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659560960:12345-0@lo:101:mount.lustre.0 Request processed in 189us (3633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350059.966587:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783350059.966669:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659560960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350059.966689:0:19407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350059.966698:0:19407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783350059.971586:0:19407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783350059.972211:0:19407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783350059.973904:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783350059.973948:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783350059.973961:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783350059.973973:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783350059.973996:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783350059.974008:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783350059.974031:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783350059.974036:0:19407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783350059.974132:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350059.974216:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350059.974260:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2432f9480 going to sleep for 11 seconds 00000100:00100000:0.0:1783350059.974411:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659561088 00000100:00100000:0.0:1783350059.974418:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659561088 00000100:00100000:0.0:1783350059.974464:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783350059.974473:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659561088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783350059.974931:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659561088:12345-0@lo:501:mount.lustre.0 Request processed in 457us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350059.974939:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783350059.975034:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350059.975086:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783350059.975127:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350059.975181:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea358f52cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350059.975248:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659561216 00000100:00100000:1.0:1783350059.975253:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659561216 00000100:00100000:1.0:1783350059.975275:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783350059.975282:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659561216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350059.975887:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659561216:12345-0@lo:503:mount.lustre.0 Request processed in 604us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350059.975895:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783350059.976014:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561216:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783350059.976535:0:19407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783350059.976726:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350059.976767:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350059.976794:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dcf5000 going to sleep for 11 seconds 00000100:00100000:1.0:1783350059.976859:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659561344 00000100:00100000:1.0:1783350059.976864:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659561344 00000100:00100000:1.0:1783350059.976888:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783350059.976894:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659561344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350059.977340:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659561344:12345-0@lo:502:mount.lustre.0 Request processed in 436us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350059.977348:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783350059.977516:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350059.977905:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783350059.977929:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783350059.977943:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783350059.977956:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783350059.977968:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783350059.977980:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783350059.977992:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783350059.978006:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783350059.978019:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1783350059.978044:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350059.978083:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350059.978179:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dcf5000 going to sleep for 11 seconds 00000100:00100000:0.0:1783350059.979798:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659561472 00000100:00100000:0.0:1783350059.979810:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659561472 00000100:00100000:0.0:1783350059.979931:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783350059.979959:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659561472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350059.980111:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659561472:12345-0@lo:502:mount.lustre.0 Request processed in 159us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350059.980119:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783350059.981660:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783350059.981751:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1783350059.981768:0:19407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1783350059.982732:0:19411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783350059.982741:0:19411:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1783350059.982747:0:19411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350059.982749:0:19411:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783350059.982755:0:19411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783350059.982769:0:19411:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ea242448000) 00000020:00000080:3.0:1783350059.982794:0:19411:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783350059.982798:0:19411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783350059.982871:0:19411:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea34778c000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783350059.982879:0:19411:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783350059.982887:0:19411:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd05e6ae1590e346c 00010000:00010000:3.0:1783350059.989747:0:19411:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1783350059.991371:0:19411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1783350059.994390:0:19411:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1783350059.998644:0:19411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783350059.998656:0:19411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350059.998662:0:19411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350059.998665:0:19411:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783350059.998668:0:19411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783350059.998673:0:19411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350059.998674:0:19411:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783350059.998677:0:19411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783350059.998679:0:19411:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783350059.998681:0:19411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350059.998683:0:19411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350059.998690:0:19411:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783350059.998693:0:19411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783350059.998696:0:19411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350059.998697:0:19411:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783350059.998701:0:19411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783350059.998729:0:19411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350059.998732:0:19411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350059.998733:0:19411:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783350059.998736:0:19411:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1783350059.999046:0:19407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1783350059.999075:0:19407:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783350059.999096:0:19407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350059.999109:0:19407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea340031600/0xd05e6ae1590e3457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e345e expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350059.999130:0:19407:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea34778c000 from 1 10000000:01000000:1.0:1783350059.999157:0:19407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783350059.999192:0:19407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350059.999201:0:19407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350059.999210:0:19407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350059.999235:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783350059.999298:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350059.999342:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659561600 00000100:00100000:1.0:1783350059.999349:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659561600 00000100:00100000:1.0:1783350059.999388:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783350059.999396:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659561600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350059.999409:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350059.999420:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e347a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3473 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350059.999443:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e347a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3473 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350059.999454:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e347a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3473 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350059.999462:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c400, rc 0) 00000100:00100000:1.0:1783350059.999498:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:19407:x1869977659561600:12345-0@lo:101:mount.lustre.0 Request processed in 102us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350059.999504:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783350059.999544:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1540 going to sleep for 11 seconds 00000100:00100000:1.0:1783350059.999575:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783350059.999588:0:19407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350059.999597:0:19407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783350060.002318:0:19407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783350060.003851:0:19407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783350060.004078:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783350060.004104:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783350060.004123:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783350060.004129:0:19407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783350060.004229:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350060.004293:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350060.004343:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1540 going to sleep for 11 seconds 00000100:00100000:3.0:1783350060.004731:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659561728 00000100:00100000:3.0:1783350060.004741:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659561728 00000100:00100000:3.0:1783350060.004790:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783350060.004797:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:19407:x1869977659561728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783350060.004903:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:19407:x1869977659561728:12345-0@lo:501:mount.lustre.0 Request processed in 106us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350060.004909:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783350060.007094:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350060.007179:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350060.007248:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350060.007282:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1540 going to sleep for 11 seconds 00000100:00100000:3.0:1783350060.008772:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659561856 00000100:00100000:3.0:1783350060.008784:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659561856 00000100:00100000:3.0:1783350060.008836:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783350060.008846:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:19407:x1869977659561856:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783350060.008995:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:19407:x1869977659561856:12345-0@lo:503:mount.lustre.0 Request processed in 150us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350060.009002:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783350060.009018:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561856:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783350060.009883:0:19407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783350060.009965:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350060.010023:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350060.010060:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9780 going to sleep for 11 seconds 00000100:00100000:2.0:1783350060.010158:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659561984 00000100:00100000:2.0:1783350060.010164:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659561984 00000100:00100000:2.0:1783350060.010205:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783350060.010213:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:19407:x1869977659561984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350060.010479:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659561984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350060.010711:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:19407:x1869977659561984:12345-0@lo:502:mount.lustre.0 Request processed in 497us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350060.010718:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000040:00080000:0.0:1783350060.010879:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783350060.010907:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783350060.010920:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783350060.010932:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783350060.010943:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1783350060.010954:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1783350060.010967:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1783350060.010981:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1783350060.010994:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783350060.011010:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1783350060.011024:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1783350060.011049:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783350060.011087:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350060.011111:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350a216c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350060.011357:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659562112 00000100:00100000:2.0:1783350060.011362:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659562112 00000100:00100000:2.0:1783350060.011639:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783350060.011648:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:19407:x1869977659562112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783350060.011740:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:19407:x1869977659562112:12345-0@lo:502:mount.lustre.0 Request processed in 93us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350060.011746:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783350060.012240:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783350060.012309:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1783350060.012318:0:19407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783350060.014263:0:19415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783350060.014276:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350060.014278:0:19415:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783350060.014291:0:19415:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea34778c000 00000020:00000080:3.0:1783350060.014295:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783350060.014303:0:19415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350060.014306:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350060.014307:0:19415:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783350060.014310:0:19415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783350060.014312:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350060.014313:0:19415:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783350060.014316:0:19415:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ea34778c000 00000020:00000080:3.0:1783350060.014318:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783350060.014384:0:19415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350060.014388:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350060.014390:0:19415:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783350060.014392:0:19415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783350060.014394:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350060.014396:0:19415:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783350060.014399:0:19415:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea34778c000 00000020:00000080:3.0:1783350060.014401:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783350060.014416:0:19415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350060.014419:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350060.014420:0:19415:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783350060.014423:0:19415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783350060.014425:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350060.014426:0:19415:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783350060.014430:0:19415:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ea34778c000 00000020:00000080:3.0:1783350060.014432:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783350060.014451:0:19415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783350060.014454:0:19415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783350060.014455:0:19415:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783350060.014458:0:19415:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1783350060.014634:0:19407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783350060.014661:0:19407:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783350060.014682:0:19407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350060.014693:0:19407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350060.014741:0:19407:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783350060.014743:0:19407:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ea34778c000 10000000:01000000:2.0:1783350060.014746:0:19407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ea34778c000 10000000:01000000:2.0:1783350060.014750:0:19407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783350060.014754:0:19407:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ea34778c000 from 1 10000000:01000000:2.0:1783350060.014757:0:19407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783350060.014788:0:19407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350060.014803:0:19407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350060.014813:0:19407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350060.014836:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783350060.014895:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350060.014925:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36dcf5840 going to sleep for 11 seconds 00000100:00100000:3.0:1783350060.019656:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659562240 00000100:00100000:3.0:1783350060.019671:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659562240 00000100:00100000:3.0:1783350060.019730:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783350060.019741:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:19407:x1869977659562240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783350060.019763:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350060.019779:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3481 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350060.019807:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3481 expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350060.019819:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea340031e00/0xd05e6ae1590e3488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3481 expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350060.019829:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340031e00, rc 0) 00000100:00100000:3.0:1783350060.019898:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562240:12345-0@lo:101:mount.lustre.0 Request processed in 159us (5003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350060.019905:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783350060.020328:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783350060.020357:0:19407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350060.020367:0:19407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783350060.027891:0:19407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1783350060.028201:0:19407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783350060.028390:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783350060.028414:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783350060.028438:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783350060.028451:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783350060.028464:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783350060.028476:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783350060.028489:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783350060.028679:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783350060.028700:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783350060.028713:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783350060.028725:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783350060.028738:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783350060.028750:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783350060.028762:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783350060.028774:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783350060.028785:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783350060.028811:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783350060.028825:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783350060.028837:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783350060.028848:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783350060.028860:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783350060.028872:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783350060.028884:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783350060.028896:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783350060.028909:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1783350060.028922:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1783350060.028935:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1783350060.028948:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1783350060.028962:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1783350060.028975:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1783350060.028989:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1783350060.029003:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1783350060.029027:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1783350060.029054:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1783350060.029069:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1783350060.029091:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1783350060.029104:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1783350060.029117:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1783350060.029130:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1783350060.029164:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1783350060.029177:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1783350060.029189:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1783350060.029201:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1783350060.029213:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1783350060.029223:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1783350060.029235:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1783350060.029258:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1783350060.029264:0:19407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1783350060.029363:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350060.029425:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350060.029466:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea35b8e3240 going to sleep for 11 seconds 00000100:00100000:2.0:1783350060.031516:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659562368 00000100:00100000:2.0:1783350060.031530:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659562368 00000100:00100000:2.0:1783350060.031602:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783350060.031611:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783350060.031766:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562368:12345-0@lo:501:mount.lustre.0 Request processed in 156us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350060.031774:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783350060.032193:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783350060.032244:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350060.032291:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350060.032320:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea35b8e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1783350060.032346:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659562496 00000100:00100000:1.0:1783350060.032350:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659562496 00000100:00100000:1.0:1783350060.032377:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783350060.032385:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562496:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783350060.032464:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562496:12345-0@lo:503:mount.lustre.0 Request processed in 80us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350060.032470:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783350060.032511:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562496:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783350060.032874:0:19407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783350060.032941:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350060.032973:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350060.032989:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350d039c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350060.033003:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659562624 00000100:00100000:1.0:1783350060.033006:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659562624 00000100:00100000:1.0:1783350060.033028:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783350060.033034:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350060.033121:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562624:12345-0@lo:502:mount.lustre.0 Request processed in 86us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350060.033128:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783350060.033189:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350060.038178:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783350060.038243:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783350060.038257:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783350060.038272:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783350060.038285:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783350060.038298:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783350060.038310:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783350060.038323:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783350060.038348:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783350060.038362:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783350060.038374:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783350060.038386:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783350060.038399:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783350060.038411:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783350060.038424:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783350060.038457:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783350060.038479:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783350060.038492:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783350060.038518:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783350060.038533:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783350060.038547:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783350060.038560:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783350060.038574:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783350060.038587:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783350060.038600:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1783350060.038614:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1783350060.038628:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1783350060.038640:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1783350060.038651:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1783350060.038663:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1783350060.038675:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1783350060.038702:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1783350060.038718:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1783350060.038731:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1783350060.038744:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1783350060.038757:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1783350060.038769:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1783350060.038782:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1783350060.038794:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1783350060.038806:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1783350060.038821:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1783350060.038834:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1783350060.038849:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1783350060.038862:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1783350060.038874:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1783350060.038886:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1783350060.038899:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1783350060.038924:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1783350060.038980:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350060.039586:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350060.039629:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350d039c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350060.039660:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659562752 00000100:00100000:1.0:1783350060.039667:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659562752 00000100:00100000:1.0:1783350060.039711:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783350060.039719:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350060.039828:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562752:12345-0@lo:502:mount.lustre.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350060.039836:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783350060.039894:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350060.043796:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1783350060.043858:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1783350060.043910:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783350060.043989:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350060.044028:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350d039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350060.047409:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659562880 00000100:00100000:3.0:1783350060.047423:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659562880 00000100:00100000:3.0:1783350060.047476:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783350060.047484:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783350060.047652:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659562880:12345-0@lo:502:mount.lustre.0 Request processed in 169us (3663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350060.047660:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783350060.047672:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659562880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783350060.047747:0:19407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1783350060.047760:0:19407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783350060.050801:0:19420:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783350060.050818:0:19420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ea370dfb380) 00000020:00000080:1.0:1783350060.050841:0:19420:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1783350060.051015:0:19420:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea34778c000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783350060.051019:0:19420:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea34778c000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783350060.051022:0:19420:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea34778c000 3 00010000:00080000:1.0:1783350060.052156:0:19420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea347506000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.150@tcp at head 00010000:00010000:1.0:1783350060.061050:0:19420:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1783350060.061174:0:19420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1783350060.061235:0:19420:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783350060.061246:0:19420:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd05e6ae1590e3496 00000100:00080000:1.0:1783350060.061256:0:19420:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783350060.061262:0:19420:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ea347506000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1783350060.061296:0:19420:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea379138000 x1869977659563008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783350060.061322:0:19420:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783350060.061365:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659563008:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1783350060.061500:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350060.061505:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350060.061508:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350060.061510:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350060.061538:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350060.061545:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783350060.061548:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783350060.061618:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1783350060.061624:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783350060.061628:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea349fe1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350060.061643:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea241da5880 x1869977659563648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350060.061679:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659563264:0@lo:400:kworker.0 00000100:00100000:3.0:1783350060.061734:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350060.061762:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659563904:0@lo:400:kworker.0 00000100:00100000:3.0:1783350060.061781:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350060.061801:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783350060.061807:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659563136:0@lo:400:kworker.0 00000100:00100000:3.0:1783350060.061827:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350060.061843:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659563776:0@lo:400:kworker.0 00000100:00100000:3.0:1783350060.061860:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350060.061881:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659563392:0@lo:400:kworker.0 00000100:00100000:3.0:1783350060.061900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350060.061915:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659564032:0@lo:400:kworker.0 00000100:00100000:3.0:1783350060.061933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350060.061943:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783350060.061948:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659563520:0@lo:400:kworker.0 00000100:00100000:3.0:1783350060.061968:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350060.062007:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659563264 00000100:00100000:3.0:1783350060.062013:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659563264 00000100:00100000:3.0:1783350060.062043:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659563904 00000100:00100000:3.0:1783350060.062047:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659563904 00000100:00100000:3.0:1783350060.062068:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659563776 00000100:00100000:3.0:1783350060.062071:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659563776 00000100:00100000:3.0:1783350060.062079:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659564032 00000100:00100000:3.0:1783350060.062081:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659564032 00000100:00100000:3.0:1783350060.062096:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783350060.062103:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659563264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350060.062171:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869977659563264:12345-0@lo:400:kworker.0 Request processed in 68us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350060.062178:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783350060.062191:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783350060.062197:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659563904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350060.062218:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869977659563904:12345-0@lo:400:kworker.0 Request processed in 22us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350060.062224:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783350060.062233:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783350060.062238:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659563776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350060.067502:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350060.067568:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659563648:0@lo:8:kworker.0 00000100:00100000:2.0:1783350060.067621:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350060.068404:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659563136 00000100:00100000:2.0:1783350060.068414:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659563136 00000100:00100000:2.0:1783350060.068458:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659563392 00000100:00100000:2.0:1783350060.068462:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659563392 00000100:00100000:2.0:1783350060.068478:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783350060.068487:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659563136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350060.068561:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659563136:12345-0@lo:400:kworker.0 Request processed in 65us (6722us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350060.068569:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783350060.068586:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783350060.068592:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659563392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350060.068625:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659563392:12345-0@lo:400:kworker.0 Request processed in 34us (6725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350060.068631:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783350060.068647:0:17089:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783350060.068653:0:17089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783350060.068677:0:17087:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783350060.068681:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659563008 00000100:00100000:2.0:1783350060.068684:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659563008 00000100:00100000:2.0:1783350060.068695:0:17087:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783350060.068700:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350060.068704:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869977659563008:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783350060.068723:0:17087:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1783350060.068756:0:17087:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd05e6ae1590e349d 00000004:00100000:2.0:1783350060.068770:0:17087:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783350060.068815:0:17087:0:(import.c:65:import_set_state_nolock()) ffff8ea241d25000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350060.068856:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869977659563008:12345-0@lo:38:llog_process_th.0 Request processed in 150us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350060.068869:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350060.068880:0:17087:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783350060.068886:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783350060.068892:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659564032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350060.068922:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659564032:12345-0@lo:400:kworker.0 Request processed in 31us (6989us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350060.068927:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1783350060.068961:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea379138000 x1869977659563008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350060.068973:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783350060.068980:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783350060.068986:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783350060.068990:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783350060.068993:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea347506000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783350060.068999:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869977659563008:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783350060.069623:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659563520 00000100:00100000:1.0:1783350060.069630:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659563520 00000100:00100000:1.0:1783350060.069660:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659563648 00000100:00100000:1.0:1783350060.069663:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659563648 00000100:00100000:1.0:1783350060.069682:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783350060.069690:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659563520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350060.069736:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659563520:12345-0@lo:400:kworker.0 Request processed in 47us (7766us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350060.069742:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783350060.069753:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783350060.069757:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659563648:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783350060.069806:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869977659563648:12345-0@lo:8:kworker.0 Request processed in 46us (2183us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783350060.069811:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350060.069901:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783350060.069908:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783350060.069912:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783350060.069915:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659563648:0@lo:8:kworker.0 00000100:00100000:3.0:1783350060.070308:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659563776:12345-0@lo:400:kworker.0 Request processed in 8067us (8444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350060.070317:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1783350060.071636:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783350060.071644:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350060.071647:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783350060.071704:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da6d80 x1869977659563520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783350076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350060.071721:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659563520:0@lo:400:kworker.0 00000100:00100000:0.0:1783350060.071735:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659563392:0@lo:400:kworker.0 00010000:00080000:0.0:1783350060.071747:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da6680 x1869977659564032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350060.071756:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659564032:0@lo:400:kworker.0 00000100:00100000:0.0:1783350060.071796:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659563136:0@lo:400:kworker.0 00010000:00080000:0.0:1783350060.071808:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da6300 x1869977659563776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350060.071817:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659563776:0@lo:400:kworker.0 00010000:00080000:0.0:1783350060.071829:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da6a00 x1869977659563264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350060.071837:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869977659563264:0@lo:400:kworker.0 00010000:00080000:0.0:1783350060.071849:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea241da5180 x1869977659563904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350060.071857:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869977659563904:0@lo:400:kworker.0 00000020:01000004:3.0:1783350060.075347:0:19420:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783350060.075366:0:19420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ea24244cd40) 00000020:00000080:3.0:1783350060.075400:0:19420:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1783350060.075934:0:19420:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ea34778c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783350060.075939:0:19420:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ea34778c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783350060.075942:0:19420:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ea34778c000 3 00010000:00080000:0.0:1783350060.075971:0:19420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ea367399000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.150@tcp at head 00010000:00010000:0.0:1783350060.079185:0:19420:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1783350060.079689:0:19420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1783350060.079742:0:19420:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783350060.079754:0:19420:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd05e6ae1590e34ab 00000100:00080000:0.0:1783350060.079764:0:19420:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783350060.079769:0:19420:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ea367399000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1783350060.079804:0:19420:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea24477dc00 x1869977659564160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783350060.079835:0:19420:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783350060.081404:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869977659564160:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783350060.081475:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350060.081534:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659564160 00000100:00100000:2.0:1783350060.081541:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659564160 00000100:00100000:2.0:1783350060.081584:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783350060.081591:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869977659564160:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783350060.081635:0:17087:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1783350060.081667:0:17087:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd05e6ae1590e34b2 00000004:00100000:2.0:1783350060.081681:0:17087:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783350060.081710:0:17087:0:(import.c:65:import_set_state_nolock()) ffff8ea241d26800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350060.081754:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869977659564160:12345-0@lo:38:llog_process_th.0 Request processed in 161us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350060.081762:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783350060.081798:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ea24477dc00 x1869977659564160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783350070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350060.081810:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783350060.081817:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783350060.081823:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783350060.081828:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783350060.081830:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea367399000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783350060.081836:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869977659564160:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783350060.082253:0:19420:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1783350060.082725:0:19407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783350060.082758:0:19407:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783350060.082817:0:19407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350060.082829:0:19407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3417c6e00/0xd05e6ae1590e3481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3488 expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783350060.082893:0:19407:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783350060.082896:0:19407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783350060.082897:0:19407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350060.082898:0:19407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350060.082899:0:19407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350060.082900:0:19407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350060.082902:0:19407:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783350060.082903:0:19407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350060.082905:0:19407:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783350060.082909:0:19407:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1783350060.082912:0:19407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783350060.082913:0:19407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783350060.082914:0:19407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350060.082915:0:19407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350060.082916:0:19407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350060.082917:0:19407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350060.082918:0:19407:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783350060.082919:0:19407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350060.082920:0:19407:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783350060.082940:0:19407:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783350060.082956:0:19407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659564288:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783350060.083003:0:19407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350060.083021:0:19407:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350d03600 going to sleep for 11 seconds 00000100:00100000:1.0:1783350060.083038:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659564288 00000100:00100000:1.0:1783350060.083054:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659564288 00000100:00100000:1.0:1783350060.083089:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783350060.083096:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:19407:x1869977659564288:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783350060.083118:0:17081:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783350060.083130:0:17081:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1783350060.086414:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350060.086424:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783350060.086426:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783350060.086435:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:0.0:1783350060.096659:0:17081:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783350060.096674:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783350060.096774:0:17103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783350060.096779:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783350060.096801:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.096820:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e342d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3426 expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.096828:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8c000/0xd05e6ae1590e343b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3434 expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.096836:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.096899:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8c000/0xd05e6ae1590e343b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3434 expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.096915:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36dd8c000/0xd05e6ae1590e343b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3434 expref: 24 pid: 17079 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350060.096929:0:17103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659564416:0@lo:104: 00000100:00100000:0.0:1783350060.096997:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783350060.097321:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e342d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3426 expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.097342:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e342d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3426 expref: 24 pid: 17079 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350060.097352:0:17103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659564544:0@lo:104: 00000100:00100000:0.0:1783350060.097381:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350060.097417:0:17103:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350832600 going to sleep for 11 seconds 00000100:00100000:0.0:1783350060.097442:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659564416 00000100:00100000:0.0:1783350060.097448:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659564416 00000100:00100000:3.0:1783350060.097464:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659564544 00000100:00100000:3.0:1783350060.097467:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659564544 00000100:00100000:0.0:1783350060.097484:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350060.098130:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+4:17103:x1869977659564416:12345-0@lo:104: 00010000:00010000:0.0:1783350060.098167:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.098249:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783350060.098257:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+4:17103:x1869977659564416:12345-0@lo:104: Request processed in 765us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350060.098266:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350060.098290:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783350060.098297:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:17103:x1869977659564544:12345-0@lo:104: 00010000:00010000:0.0:1783350060.098304:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.098348:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783350060.098353:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:17103:x1869977659564544:12345-0@lo:104: Request processed in 58us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350060.098366:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783350060.098403:0:17103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659564416:0@lo:104: 00000100:00100000:0.0:1783350060.098412:0:17103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1869977659564544:0@lo:104: 00010000:00010000:0.0:1783350060.098429:0:17103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.101413:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350060.101425:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.101436:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8da00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350060.101440:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.101450:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350060.101457:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350060.101462:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783350060.101511:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.101517:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350060.101540:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.101547:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8da00/0xd05e6ae1590e3434 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e343b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.103408:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350060.103413:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.103420:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c800 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350060.103424:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.103433:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350060.103440:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350060.103446:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783350060.103490:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.103497:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350060.103519:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.103526:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c800/0xd05e6ae1590e3426 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e342d expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.103539:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350060.103541:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350060.103543:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350060.103572:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659564672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350060.103642:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350060.103701:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659564800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350060.103721:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350060.103756:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659564672 00000100:00100000:0.0:1783350060.103763:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659564672 00010000:00010000:0.0:1783350060.103788:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8c000/0xd05e6ae1590e343b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3434 expref: 25 pid: 17079 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350060.103812:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659564800 00000100:00100000:0.0:1783350060.103814:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659564800 00010000:00010000:0.0:1783350060.103824:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e342d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3426 expref: 26 pid: 17079 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350060.103839:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350060.103848:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+26:3649:x1869977659564672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350060.103861:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350060.103865:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8c000/0xd05e6ae1590e343b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3434 expref: 26 pid: 17079 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.103876:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8c000/0xd05e6ae1590e343b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3434 expref: 26 pid: 17079 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.103889:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8c000/0xd05e6ae1590e343b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3434 expref: 26 pid: 17079 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.103900:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350060.103930:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+25:3649:x1869977659564672:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350060.103937:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783350060.103965:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783350060.103970:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3646:x1869977659564800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350060.103978:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350060.103982:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e342d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3426 expref: 24 pid: 17079 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.103991:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e342d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3426 expref: 24 pid: 17079 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104001:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8d000/0xd05e6ae1590e342d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3426 expref: 24 pid: 17079 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104011:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104019:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783350060.104034:0:17074:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008695573s 00010000:00010000:0.0:1783350060.104038:0:17074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104045:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104052:0:17074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104058:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104064:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364ba00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350060.104074:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104081:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104094:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104103:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350060.104130:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:3646:x1869977659564800:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350060.104159:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783350060.104191:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659564672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783350060.104213:0:17103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104220:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350060.104226:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea24364ba00/0xd05e6ae1590e34b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350060.104247:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659564800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783350060.104316:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:19407:x1869977659564288:12345-0@lo:253:mount.lustre.0 Request processed in 21220us (21313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350060.104325:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783350060.105190:0:19407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:19407:1869977659564288:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783350060.105203:0:19407:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783350060.105206:0:19407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783350060.105217:0:19407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783350060.105218:0:19407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783350060.105220:0:19407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783350060.105315:0:19407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783350060.105317:0:19407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783350060.105318:0:19407:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783350060.105320:0:19407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783350060.105321:0:19407:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783350060.105344:0:19407:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1783350060.119764:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1783350060.125106:0:19407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1783350060.130213:0:19407:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783350060.130236:0:19407:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783350060.130269:0:19407:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783350060.130313:0:19407:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783350060.130337:0:19407:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1783350060.130354:0:19407:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1783350060.131218:0:19407:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783350060.132652:0:19407:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783350060.741256:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783350061.151760:0:19475:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783350061.152048:0:19475:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1783350061.704437:0:17084:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783350061.704446:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea348c55800 from 10 10000000:01000000:2.0:1783350061.704451:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783350061.704496:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350061.704507:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350061.704517:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350061.704566:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659564928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783350061.704634:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350061.704675:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19180 going to sleep for 11 seconds 00000100:00100000:3.0:1783350061.705414:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659564928 00000100:00100000:3.0:1783350061.705423:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659564928 00000100:00100000:3.0:1783350061.706095:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783350061.706109:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:17084:x1869977659564928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350061.706127:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350061.706170:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e34c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e34c0 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350061.706198:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e34c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e34c0 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350061.706209:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea340030a00/0xd05e6ae1590e34c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e34c0 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350061.706219:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea340030a00, rc 0) 00000100:00100000:3.0:1783350061.706289:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:17084:x1869977659564928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350061.706295:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783350061.708591:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659564928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350061.708618:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350061.708630:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350061.708705:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659565056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783350061.708763:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350061.708804:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350061.708841:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659565056 00000100:00100000:2.0:1783350061.708847:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659565056 00000100:00100000:2.0:1783350061.708890:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783350061.708898:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:17084:x1869977659565056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783350061.709041:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783350061.709058:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783350061.709061:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1783350061.709166:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:17084:x1869977659565056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 268us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350061.709174:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783350061.709221:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659565056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783350061.709277:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783350061.709289:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350061.709812:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7400/0xd05e6ae1590e34c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e34c7 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350061.709830:0:17084:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783350061.709833:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ea37f5b5800 from 10 10000000:01000000:2.0:1783350061.709837:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783350061.709869:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350061.709879:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350061.709889:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350061.710194:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659565184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783350061.710245:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350061.710279:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350061.710296:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659565184 00000100:00100000:2.0:1783350061.710423:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659565184 00000100:00100000:2.0:1783350061.710493:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783350061.710502:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:17084:x1869977659565184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350061.710514:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350061.710527:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3417c7800/0xd05e6ae1590e34d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e34ce expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350061.710560:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3417c7800/0xd05e6ae1590e34d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e34ce expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350061.710579:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3417c7800/0xd05e6ae1590e34d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e34ce expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350061.710588:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3417c7800, rc 0) 00000100:00100000:2.0:1783350061.710620:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:17084:x1869977659565184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350061.710625:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783350061.722216:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659565184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350061.722245:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350061.722258:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350061.724916:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659565312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783350061.724990:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350061.725033:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2432f9180 going to sleep for 11 seconds 00000100:00100000:3.0:1783350061.725057:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659565312 00000100:00100000:3.0:1783350061.725063:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659565312 00000100:00100000:3.0:1783350061.725109:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783350061.725117:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:17084:x1869977659565312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783350061.725150:0:17079:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783350061.725170:0:17079:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783350061.725173:0:17079:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1783350061.725252:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:17084:x1869977659565312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350061.725262:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783350061.725613:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cf4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659565312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783350061.725676:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783350061.725685:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350061.725695:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7200/0xd05e6ae1590e34ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e34d5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350061.766010:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350062.148309:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350042/real 1783350042] req@ffff8ea243083b80 x1869977659551360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350062.148352:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea243083b80 x1869977659551360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350062.148363:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783350042/real 1783350042] req@ffff8ea243082680 x1869977659551488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350062.148374:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ea243082680 x1869977659551488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783350062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783350062.148392:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350062.148417:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783350062.148422:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659551360:0@lo:8:kworker.0 00000100:00080000:0.0:1783350062.148428:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d970000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783350062.148434:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783350062.148436:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659551488:0@lo:8:kworker.0 00000100:00080000:2.0:1783350062.149094:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350062.149099:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783350062.149102:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350062.149107:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:2.0:1783350062.149120:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783350062.149127:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ea243259000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350062.149163:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783350062.149163:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243083480 x1869977659565568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350062.149177:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659565440:0@lo:400:kworker.0 00000100:00080000:2.0:1783350062.149178:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350062.149181:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783350062.149183:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea36d970000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350062.149186:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:2.0:1783350062.149189:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783350062.149192:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ea36d970000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1783350062.149250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350062.150128:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea243082680 x1869977659565696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350062.150277:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783350062.150293:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659565824:0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.150347:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783350062.150898:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783350062.150913:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783350062.150916:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783350062.150925:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ea349fe1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1783350062.150942:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ea241da6a00 x1869977659566208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783350062.150945:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659565952:0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.150987:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350062.151283:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783350062.151303:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659566080:0@lo:400:kworker.0 00000100:00100000:0.0:1783350062.151344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350062.151452:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659566080 00000100:00100000:3.0:1783350062.151460:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659566080 00000100:00100000:3.0:1783350062.151528:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783350062.151537:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659566080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.151586:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659566080:12345-0@lo:400:kworker.0 Request processed in 50us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350062.151594:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783350062.152030:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783350062.152058:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da5180 x1869977659566080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783350078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350062.152072:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659566080:0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.153127:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659566464:0@lo:400:kworker.0 00000100:00100000:2.0:1783350062.153154:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659565440 00000100:00100000:2.0:1783350062.153160:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659565440 00000100:00100000:3.0:1783350062.153203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350062.153230:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783350062.153236:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659566592:0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.153257:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350062.153294:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659565824 00000100:00100000:3.0:1783350062.153298:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659565824 00000100:00100000:3.0:1783350062.153333:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659566464 00000100:00100000:3.0:1783350062.153337:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659566464 00000100:00100000:3.0:1783350062.153354:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659566592 00000100:00100000:3.0:1783350062.153356:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659566592 00000100:00100000:3.0:1783350062.153371:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783350062.153378:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659565824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.153420:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659565824:12345-0@lo:400:kworker.0 Request processed in 41us (3072us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350062.153427:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783350062.153450:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783350062.153455:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659566464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.153485:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659566464:12345-0@lo:400:kworker.0 Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350062.153501:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783350062.153512:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783350062.153518:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659566592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.153545:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659566592:12345-0@lo:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350062.153551:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1783350062.153579:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da6680 x1869977659566592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350062.153591:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659566592:0@lo:400:kworker.0 00010000:00080000:3.0:1783350062.153601:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da7100 x1869977659566464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350062.153609:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659566464:0@lo:400:kworker.0 00000100:00080000:0.0:1783350062.154267:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350062.154272:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783350062.154367:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659566336:0@lo:400:kworker.0 00000100:00100000:0.0:1783350062.154408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350062.154432:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659566848:0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.154442:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659566336 00000100:00100000:3.0:1783350062.154447:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659566336 00000100:00100000:0.0:1783350062.154456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350062.154467:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659566848 00000100:00100000:0.0:1783350062.154468:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783350062.154470:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659566848 00000100:00100000:0.0:1783350062.154473:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659566720:0@lo:400:kworker.0 00000100:00100000:0.0:1783350062.154495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350062.154500:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659566720 00000100:00100000:3.0:1783350062.154502:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659566720 00000100:00080000:0.0:1783350062.154509:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783350062.154511:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783350062.154516:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783350062.154523:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659566336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.154564:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659566336:12345-0@lo:400:kworker.0 Request processed in 41us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350062.154578:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783350062.154592:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783350062.154597:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659566848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.154625:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659566848:12345-0@lo:400:kworker.0 Request processed in 28us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350062.154630:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783350062.154641:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783350062.154646:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659566720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.154671:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659566720:12345-0@lo:400:kworker.0 Request processed in 25us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350062.154676:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783350062.155069:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659565952 00000100:00100000:2.0:1783350062.155074:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659565952 00000100:00100000:2.0:1783350062.155093:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783350062.155100:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659565440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350062.155152:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659565440:12345-0@lo:400:kworker.0 Request processed in 52us (5902us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350062.155158:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783350062.155170:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783350062.155176:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659565952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.155311:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659565440:0@lo:400:kworker.0 00000100:00100000:3.0:1783350062.155346:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659565568:0@lo:8:kworker.0 00000100:00100000:3.0:1783350062.155374:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350062.155403:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659565696:0@lo:8:kworker.0 00000100:00100000:3.0:1783350062.155427:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350062.155441:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659566208:0@lo:8:kworker.0 00000100:00100000:3.0:1783350062.155460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350062.156345:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659565952:12345-0@lo:400:kworker.0 Request processed in 1164us (5352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350062.156360:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783350062.156426:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659565952:0@lo:400:kworker.0 00010000:00080000:2.0:1783350062.156442:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243083b80 x1869977659565824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350062.156453:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659565824:0@lo:400:kworker.0 00000100:00100000:0.0:1783350062.157033:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659565696 00000100:00100000:0.0:1783350062.157042:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659565696 00000100:00100000:0.0:1783350062.157083:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659566208 00000100:00100000:0.0:1783350062.157086:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659566208 00000100:00100000:0.0:1783350062.157098:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783350062.157105:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1869977659565696:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783350062.157160:0:19278:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000100:00100000:3.0:1783350062.157183:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659565568 00000100:00100000:3.0:1783350062.157188:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659565568 00000020:00000080:0.0:1783350062.157190:0:19278:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e34dc 00000100:00100000:3.0:1783350062.157205:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783350062.157210:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1869977659566208:12345-0@lo:8:kworker.0 00002000:00100000:0.0:1783350062.157212:0:19278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ea36739f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783350062.157216:0:19278:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783350062.157219:0:19278:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1783350062.157223:0:18596:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:3.0:1783350062.157238:0:18596:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd05e6ae1590e34e3 00002000:00100000:3.0:1783350062.157249:0:18596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8ea2435c5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1783350062.157252:0:18596:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1783350062.157253:0:18596:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783350062.158768:0:19278:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783350062.159048:0:19278:0:(import.c:65:import_set_state_nolock()) ffff8ea36739e000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1783350062.162172:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da4a80 x1869977659566720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350062.162225:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659566720:0@lo:400:kworker.0 00010000:00080000:2.0:1783350062.162249:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da6300 x1869977659566336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350062.162258:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659566336:0@lo:400:kworker.0 00010000:00080000:2.0:1783350062.162272:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da6d80 x1869977659566848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350062.162279:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659566848:0@lo:400:kworker.0 00002000:00080000:3.0:1783350062.162470:0:18596:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:0.0:1783350062.162741:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1869977659565696:12345-0@lo:8:kworker.0 Request processed in 5632us (7308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350062.162752:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783350062.162786:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783350062.162803:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1869977659565568:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783350062.162833:0:19278:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1783350062.162870:0:19278:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd05e6ae1590e34ea 00002000:00100000:0.0:1783350062.162883:0:19278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ea367398000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783350062.162887:0:19278:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783350062.162889:0:19278:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783350062.163074:0:19278:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783350062.163097:0:19278:0:(import.c:65:import_set_state_nolock()) ffff8ea36739a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350062.163182:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1869977659565568:12345-0@lo:8:kworker.0 Request processed in 389us (7807us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350062.163189:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1783350062.164354:0:18596:0:(import.c:65:import_set_state_nolock()) ffff8ea2435c1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783350062.164426:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1869977659566208:12345-0@lo:8:kworker.0 Request processed in 7212us (8962us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350062.164436:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783350062.166925:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243082680 x1869977659565696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783350087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350062.166940:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783350062.167016:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783350062.167027:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783350062.167033:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783350062.167036:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea36d970000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783350062.167099:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783350062.167106:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659565696:0@lo:8:kworker.0 00010000:00080000:3.0:1783350062.167469:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da6a00 x1869977659566208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783350087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783350062.167482:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1783350062.167496:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783350062.167501:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783350062.167503:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea349fe1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783350062.167528:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783350062.167533:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869977659566208:0@lo:8:kworker.0 00010000:00080000:3.0:1783350062.167567:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243083480 x1869977659565568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783350087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783350062.167575:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783350062.167579:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783350062.167584:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783350062.167587:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783350062.167589:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ea243259000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783350062.167601:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783350062.167604:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869977659565568:0@lo:8:kworker.0 00000004:00080000:3.0:1783350062.167628:0:17111:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783350062.167731:0:17111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 502962593990ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783350062.167738:0:17111:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1783350062.168242:0:17832:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1783350062.168265:0:17832:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17832:1869977659567104:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1783350062.168333:0:17832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350062.168356:0:17832:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357e9e600 going to sleep for 11 seconds 00000100:00100000:1.0:1783350062.168377:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659566976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783350062.168402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783350062.168843:0:17114:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1783350062.168858:0:17114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17114:1869977659567360:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783350062.168883:0:17114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350062.168896:0:17114:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea37b5d3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350062.168908:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659567232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783350062.168925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350062.168966:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659567104 00000100:00100000:2.0:1783350062.168972:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659567104 00000100:00100000:2.0:1783350062.169025:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659567360 00000100:00100000:2.0:1783350062.169028:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659567360 00000100:00100000:2.0:1783350062.169055:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783350062.169062:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17832:x1869977659567104:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1783350062.169862:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659566976 00000100:00100000:2.0:1783350062.169869:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659566976 00000100:00100000:2.0:1783350062.169896:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659567232 00000100:00100000:2.0:1783350062.169898:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659567232 00000100:00100000:2.0:1783350062.169918:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783350062.169932:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869977659566976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783350062.170177:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783350062.170705:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869977659566976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 607us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350062.170714:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783350062.170735:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783350062.170742:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659567232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783350062.170752:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783350062.170782:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869977659567232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350062.170787:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783350062.170874:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783350062.170882:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17114:x1869977659567360:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:2.0:1783350062.171388:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea241da6d80 x1869977659567232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783350078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350062.171410:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659567232:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1783350062.171724:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37913a680 x1869977659566976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783350078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350062.171739:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659566976:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1783350062.176236:0:17113:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783350062.176729:0:17113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 502971591680ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783350062.176748:0:17113:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1783350062.176773:0:17831:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783350062.176825:0:17831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 502971688240ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783350062.176830:0:17831:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1783350062.176892:0:17112:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1783350062.177919:0:17112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17112:1869977659567616:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783350062.180092:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350062.180131:0:17112:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350832900 going to sleep for 11 seconds 00000100:00100000:2.0:1783350062.180769:0:18596:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1783350062.180778:0:18596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1783350062.182760:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659567488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783350062.183048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783350062.183131:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783350062.183782:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659567488 00000100:00100000:0.0:1783350062.183792:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659567488 00000100:00100000:0.0:1783350062.183857:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783350062.183865:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869977659567488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783350062.183896:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783350062.183971:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869977659567488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350062.183978:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783350062.184018:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24477f480 x1869977659567488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783350078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350062.184039:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659567488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783350062.184068:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783350062.184076:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659567616 00000100:00100000:0.0:1783350062.184080:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659567616 00000100:00100000:1.0:1783350062.184822:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783350062.184832:0:19527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17112:x1869977659567616:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1783350062.185643:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1783350062.198436:0:18595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1783350062.198446:0:18595:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1783350062.199190:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17832:x1869977659567104:12345-0@lo:7:osp-pre-1-1.0 Request processed in 30122us (30851us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350062.199211:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783350062.200889:0:17832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37913aa00 x1869977659567104/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783350078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350062.200908:0:17832:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17832:1869977659567104:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1783350062.200922:0:17832:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1783350062.200961:0:17832:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17832:1869977659567744:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1783350062.201029:0:17832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350062.201060:0:17832:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357e9e600 going to sleep for 11 seconds 00000100:00100000:1.0:1783350062.201079:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659567744 00000100:00100000:1.0:1783350062.201085:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659567744 00000004:00080000:0.0:1783350062.201842:0:17067:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783350062.203290:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783350062.203302:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17832:x1869977659567744:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1783350062.203355:0:19278:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1783350062.203428:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17832:x1869977659567744:12345-0@lo:5:osp-pre-1-1.0 Request processed in 128us (2399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350062.203435:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1783350062.203476:0:17832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea37913aa00 x1869977659567744/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783350078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350062.203490:0:17832:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17832:1869977659567744:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1783350062.203509:0:17832:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1783350062.203550:0:17832:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37913aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17832:1869977659567872:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1783350062.203582:0:17832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350062.203600:0:17832:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357e9e600 going to sleep for 11 seconds 00002000:00080000:2.0:1783350062.204184:0:18594:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00000100:00100000:0.0:1783350062.204389:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659567872 00000100:00100000:0.0:1783350062.204396:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659567872 00000100:00100000:0.0:1783350062.204431:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783350062.204438:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17832:x1869977659567872:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1783350062.204468:0:18594:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1783350062.204480:0:18594:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:3.0:1783350062.205663:0:19527:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1783350062.205673:0:19527:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1783350062.205678:0:19527:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00080000:0.0:1783350062.214895:0:18596:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1783350062.219234:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.219247:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000814ac6d0/0xd05e6ae1590e34f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.219267:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.219271:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.219278:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000814ac6d0/0xd05e6ae1590e34f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.219294:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000814ac6d0/0xd05e6ae1590e34f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.219305:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000814ac6d0/0xd05e6ae1590e34f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783350062.219755:0:17067:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1783350062.220055:0:17820:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:2.0:1783350062.227790:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000814ac6d0/0xd05e6ae1590e34f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.227819:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350062.233154:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350062.233166:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000814ac6d0/0xd05e6ae1590e34f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.233182:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.233186:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000814ac6d0/0xd05e6ae1590e34f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.233211:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000814ac6d0/0xd05e6ae1590e34f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.233233:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000814ac6d0/0xd05e6ae1590e34f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.233241:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000814ac6d0/0xd05e6ae1590e34f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.233262:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.233265:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.233266:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.237884:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.237899:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e34f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.237917:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.237923:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.237930:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e34f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.237945:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e34f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.237957:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e34f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.237972:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e34f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.237995:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350062.238010:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350062.238017:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e34f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238027:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c6600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.238032:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e34f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238043:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e34f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238064:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e34f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238072:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000653d6f9d/0xd05e6ae1590e34f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238101:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.238104:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.238108:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.238873:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.238889:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081734286/0xd05e6ae1590e34ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238900:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.238903:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.238908:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081734286/0xd05e6ae1590e34ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238917:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081734286/0xd05e6ae1590e34ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238926:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081734286/0xd05e6ae1590e34ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238933:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081734286/0xd05e6ae1590e34ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238948:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350062.238958:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350062.238963:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081734286/0xd05e6ae1590e34ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238971:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.238975:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081734286/0xd05e6ae1590e34ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.238983:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081734286/0xd05e6ae1590e34ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.239001:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081734286/0xd05e6ae1590e34ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.239009:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081734286/0xd05e6ae1590e34ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.239031:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.239033:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.239037:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.240288:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.240299:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000126d87f5/0xd05e6ae1590e3506 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.240327:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.240331:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.240336:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000126d87f5/0xd05e6ae1590e3506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.240347:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000126d87f5/0xd05e6ae1590e3506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.240356:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000126d87f5/0xd05e6ae1590e3506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.240364:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000126d87f5/0xd05e6ae1590e3506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.240388:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350062.240397:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350062.240402:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000126d87f5/0xd05e6ae1590e3506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.240410:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ea00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.240413:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000126d87f5/0xd05e6ae1590e3506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.240422:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000126d87f5/0xd05e6ae1590e3506 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.240436:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000126d87f5/0xd05e6ae1590e3506 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.240442:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000126d87f5/0xd05e6ae1590e3506 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.240456:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.240458:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.240459:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.241867:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.241878:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad96f307/0xd05e6ae1590e350d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.241891:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.241902:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.241907:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad96f307/0xd05e6ae1590e350d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.241918:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad96f307/0xd05e6ae1590e350d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.241929:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad96f307/0xd05e6ae1590e350d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.241937:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad96f307/0xd05e6ae1590e350d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.241955:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350062.241966:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350062.241971:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad96f307/0xd05e6ae1590e350d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.241978:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.241982:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad96f307/0xd05e6ae1590e350d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.241990:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad96f307/0xd05e6ae1590e350d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.242004:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad96f307/0xd05e6ae1590e350d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.242020:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad96f307/0xd05e6ae1590e350d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.242037:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.242039:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.242040:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.245500:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1783350062.245501:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.245519:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e3514 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.245519:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b7c66e5/0xd05e6ae1590e351b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.245545:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.245547:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.245552:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.245553:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.245563:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e3514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.245564:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b7c66e5/0xd05e6ae1590e351b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.245590:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e3514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.245601:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e3514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.245609:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e3514 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.245631:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.245643:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.245649:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e3514 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.245669:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340031c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.245673:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e3514 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.245683:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e3514 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.245700:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e3514 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.245707:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ec2b83f/0xd05e6ae1590e3514 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.245726:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.245728:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.245730:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.245885:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b7c66e5/0xd05e6ae1590e351b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.245895:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b7c66e5/0xd05e6ae1590e351b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.245902:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b7c66e5/0xd05e6ae1590e351b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.245985:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783350062.246490:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.246502:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8541dda/0xd05e6ae1590e3522 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.246512:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.246515:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.246519:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8541dda/0xd05e6ae1590e3522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.246528:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8541dda/0xd05e6ae1590e3522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.246537:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8541dda/0xd05e6ae1590e3522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.246543:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8541dda/0xd05e6ae1590e3522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246624:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.246629:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b7c66e5/0xd05e6ae1590e351b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246638:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.246642:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b7c66e5/0xd05e6ae1590e351b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246651:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b7c66e5/0xd05e6ae1590e351b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246672:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b7c66e5/0xd05e6ae1590e351b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246679:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b7c66e5/0xd05e6ae1590e351b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246695:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.246696:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.246698:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.246718:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.246724:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.246729:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8541dda/0xd05e6ae1590e3522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246736:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.246738:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8541dda/0xd05e6ae1590e3522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246746:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8541dda/0xd05e6ae1590e3522 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246756:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8541dda/0xd05e6ae1590e3522 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246763:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8541dda/0xd05e6ae1590e3522 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246788:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.246790:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.246792:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.246820:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.246825:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc0d75b/0xd05e6ae1590e3529 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246833:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.246836:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.246840:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fc0d75b/0xd05e6ae1590e3529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246850:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fc0d75b/0xd05e6ae1590e3529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246857:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc0d75b/0xd05e6ae1590e3529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246863:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fc0d75b/0xd05e6ae1590e3529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.246884:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783350062.247458:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.247466:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ec68a6/0xd05e6ae1590e3530 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247489:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.247492:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.247497:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ec68a6/0xd05e6ae1590e3530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247506:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9ec68a6/0xd05e6ae1590e3530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247514:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ec68a6/0xd05e6ae1590e3530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247522:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ec68a6/0xd05e6ae1590e3530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247543:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783350062.247551:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783350062.247555:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fc0d75b/0xd05e6ae1590e3529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247561:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.247565:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc0d75b/0xd05e6ae1590e3529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247573:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc0d75b/0xd05e6ae1590e3529 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247595:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fc0d75b/0xd05e6ae1590e3529 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247602:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fc0d75b/0xd05e6ae1590e3529 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247618:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.247621:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9ec68a6/0xd05e6ae1590e3530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247627:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea340030c00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.247630:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ec68a6/0xd05e6ae1590e3530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247637:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ec68a6/0xd05e6ae1590e3530 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247645:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9ec68a6/0xd05e6ae1590e3530 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247651:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9ec68a6/0xd05e6ae1590e3530 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.247661:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.247662:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.247667:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.248151:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.248158:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e3537 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248167:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.248171:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.248175:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e3537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248195:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e3537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248203:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e3537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248210:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e3537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248223:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.248230:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.248234:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e3537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248240:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.248244:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e3537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248263:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e3537 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248275:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e3537 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248282:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e3537 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248295:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.248297:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.248299:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.248400:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.248516:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.248523:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd2bf67a/0xd05e6ae1590e353e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.248533:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.248536:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.248541:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2bf67a/0xd05e6ae1590e353e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.248561:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd2bf67a/0xd05e6ae1590e353e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.248570:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd2bf67a/0xd05e6ae1590e353e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.248588:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2bf67a/0xd05e6ae1590e353e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.248606:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.248876:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.248882:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd2bf67a/0xd05e6ae1590e353e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248889:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.248892:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd2bf67a/0xd05e6ae1590e353e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248900:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd2bf67a/0xd05e6ae1590e353e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248914:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd2bf67a/0xd05e6ae1590e353e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.248932:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd2bf67a/0xd05e6ae1590e353e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783350062.248950:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.248951:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.248954:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.248958:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.248960:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3545 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.248970:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.248973:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.248977:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.248985:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.248993:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249010:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249022:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350062.249030:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350062.249033:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249040:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fc00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.249043:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249051:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3545 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249061:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3545 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249067:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3545 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249081:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.249082:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.249084:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.249411:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.249418:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e354c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.249426:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.249430:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.249434:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e354c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.249444:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e354c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.249451:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e354c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.249459:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e354c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.249473:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.249482:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.249491:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e354c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.249498:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.249502:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e354c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783350062.249508:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.249510:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e354c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.249524:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e354c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249525:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3553 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249539:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.249542:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.249546:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249556:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249564:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249571:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249595:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350062.249602:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.249661:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e354c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.249676:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.249678:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.249679:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.249984:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.249990:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003239b2c4/0xd05e6ae1590e355a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.249999:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.250002:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.250006:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003239b2c4/0xd05e6ae1590e355a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.250025:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003239b2c4/0xd05e6ae1590e355a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.250033:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003239b2c4/0xd05e6ae1590e355a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.250040:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003239b2c4/0xd05e6ae1590e355a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.250164:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783350062.250560:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.250566:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e3561 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.250588:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.250591:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.250595:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e3561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.250605:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e3561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.250613:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e3561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.250630:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e3561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.250639:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783350062.250752:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783350062.250758:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003239b2c4/0xd05e6ae1590e355a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250767:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fa00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.250771:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003239b2c4/0xd05e6ae1590e355a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250790:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003239b2c4/0xd05e6ae1590e355a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250805:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003239b2c4/0xd05e6ae1590e355a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250813:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003239b2c4/0xd05e6ae1590e355a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250829:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.250831:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e3561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250837:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.250840:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e3561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250847:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e3561 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250855:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e3561 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250861:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e3561 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250884:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.250885:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.250887:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.250925:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.250930:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e3568 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250938:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.250941:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.250945:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e3568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250955:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e3568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.250962:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e3568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.258226:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e3568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.258273:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783350062.259035:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.259046:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63ab606/0xd05e6ae1590e356f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.259060:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.259064:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.259070:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63ab606/0xd05e6ae1590e356f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.259084:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b63ab606/0xd05e6ae1590e356f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.259094:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63ab606/0xd05e6ae1590e356f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.259101:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b63ab606/0xd05e6ae1590e356f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.259109:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783350062.261148:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783350062.261162:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e3568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.261194:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.261199:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e3568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.261210:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e3568 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.261582:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e3568 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.261592:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e3568 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.261618:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.261623:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b63ab606/0xd05e6ae1590e356f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.261630:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.261633:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63ab606/0xd05e6ae1590e356f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.261640:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63ab606/0xd05e6ae1590e356f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.261651:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b63ab606/0xd05e6ae1590e356f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.261665:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b63ab606/0xd05e6ae1590e356f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.261682:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.261684:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.261686:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.261851:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350062.262752:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350062.262763:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b3fda63/0xd05e6ae1590e3576 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.262778:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1783350062.262783:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350062.262788:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b3fda63/0xd05e6ae1590e3576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.262812:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b3fda63/0xd05e6ae1590e3576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.262821:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b3fda63/0xd05e6ae1590e3576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.262830:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b3fda63/0xd05e6ae1590e3576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.263209:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.263647:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.263655:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b3fda63/0xd05e6ae1590e3576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.263665:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8de00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.263669:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b3fda63/0xd05e6ae1590e3576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.263672:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.263681:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b3fda63/0xd05e6ae1590e3576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.263701:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b3fda63/0xd05e6ae1590e3576 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.263701:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.263707:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.263714:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b3fda63/0xd05e6ae1590e3576 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.263723:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3553 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.263740:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.263742:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3553 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.263744:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.263747:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.263753:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e3553 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.263774:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.263776:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.263778:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.263836:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.263842:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e357d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.263852:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.263856:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.263861:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e357d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.263873:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e357d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.263888:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e357d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.263895:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e357d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.263915:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350062.264021:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350062.264032:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e357d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.264040:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fe00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.264043:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e357d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.264050:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e357d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.264064:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e357d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.264071:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e0bf436/0xd05e6ae1590e357d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.264087:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.264088:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.264090:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.266662:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.266678:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc0c0588/0xd05e6ae1590e3584 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.266696:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.266701:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.266707:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc0c0588/0xd05e6ae1590e3584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.266722:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc0c0588/0xd05e6ae1590e3584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.266732:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc0c0588/0xd05e6ae1590e3584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.266741:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc0c0588/0xd05e6ae1590e3584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.266774:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783350062.270503:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350062.270515:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e358b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270533:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1783350062.270542:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350062.270549:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e358b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270564:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e358b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270586:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e358b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270594:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e358b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270613:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783350062.270624:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350062.270630:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc0c0588/0xd05e6ae1590e3584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270636:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350062.270641:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc0c0588/0xd05e6ae1590e3584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270649:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc0c0588/0xd05e6ae1590e3584 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270667:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc0c0588/0xd05e6ae1590e3584 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270674:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc0c0588/0xd05e6ae1590e3584 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270692:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350062.270699:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e358b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270706:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350062.270708:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e358b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270716:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e358b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270726:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e358b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270732:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e358b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.270743:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.270744:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.270746:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.271510:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350062.271934:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350062.271942:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3592 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.271955:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1783350062.271958:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350062.271963:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.272631:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.272641:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.272648:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783350062.272885:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.272894:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3599 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.272905:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.272908:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.272913:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.272922:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.272930:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.272938:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.272960:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350062.274277:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350062.274287:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.274310:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8fc00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.274322:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.274351:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3599 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.274371:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3599 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.274377:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1eaee9/0xd05e6ae1590e3599 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.274400:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.274402:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.274404:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.277584:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.277598:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad96f307/0xd05e6ae1590e35a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.277615:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.277626:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.277633:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad96f307/0xd05e6ae1590e35a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.277648:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad96f307/0xd05e6ae1590e35a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.277658:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad96f307/0xd05e6ae1590e35a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.277666:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad96f307/0xd05e6ae1590e35a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.277685:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783350062.279562:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.279587:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e35a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279589:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783350062.279606:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.279610:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.279617:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e35a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.279632:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e35a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.279642:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e35a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.279657:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e35a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.279699:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783350062.279760:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783350062.279768:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad96f307/0xd05e6ae1590e35a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279778:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.279783:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad96f307/0xd05e6ae1590e35a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279792:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad96f307/0xd05e6ae1590e35a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279811:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad96f307/0xd05e6ae1590e35a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279818:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad96f307/0xd05e6ae1590e35a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279834:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783350062.279838:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279845:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.279848:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279868:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3592 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279880:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3592 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279887:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3592 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279901:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.279904:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e35a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279910:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ea00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.279913:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e35a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279920:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e35a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279929:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e35a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279936:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e35a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.279960:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.279962:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.279963:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.280030:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.280695:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.280704:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e35ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.280717:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.280721:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.280725:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e35ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.280736:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e35ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.280744:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e35ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.280751:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e35ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.280766:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350062.284801:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350062.284811:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e35ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.284825:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350062.284829:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e35ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.284840:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e35ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.284862:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e35ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.284869:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7ca65a/0xd05e6ae1590e35ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.284903:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.284905:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.284907:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.285354:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.285364:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.285376:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.285381:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.285387:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.285401:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.285410:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.285417:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.285435:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.285469:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.285474:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.285491:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.285495:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.285503:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.285513:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.285520:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.285534:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.285536:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.285538:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.287957:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.287972:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e35bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.288003:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.288008:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.288015:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e35bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.288030:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e35bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.288040:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e35bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.288048:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e35bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.288066:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350062.288661:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350062.288669:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e35bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.288681:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ee00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.288685:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e35bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.288695:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e35bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783350062.288704:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.288710:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e35c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.288711:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e35bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.288719:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.288723:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350062.288725:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005913a737/0xd05e6ae1590e35bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.288728:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e35c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.288738:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e35c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.288743:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.288745:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.288748:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.288751:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e35c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.288758:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e35c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783350062.288777:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.288780:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350062.288785:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b07ee184/0xd05e6ae1590e35ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.288795:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.288799:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.288803:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b07ee184/0xd05e6ae1590e35ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.288814:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b07ee184/0xd05e6ae1590e35ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.288832:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b07ee184/0xd05e6ae1590e35ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.288840:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b07ee184/0xd05e6ae1590e35ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.288853:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783350062.289020:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783350062.289025:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e35c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.289033:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.289037:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e35c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.289045:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e35c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.289058:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e35c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.289065:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b06044fd/0xd05e6ae1590e35c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.289078:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350062.289082:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b07ee184/0xd05e6ae1590e35ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.289095:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ec00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.289099:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b07ee184/0xd05e6ae1590e35ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.289102:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.289107:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b07ee184/0xd05e6ae1590e35ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.289116:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b07ee184/0xd05e6ae1590e35ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.289123:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b07ee184/0xd05e6ae1590e35ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.289157:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.289159:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.289161:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.289166:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.290403:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.290415:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.290431:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.290434:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.290439:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.290450:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.290458:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.290465:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.290500:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783350062.291004:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.291011:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e35d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.291019:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.291022:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.291026:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e35d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.291035:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e35d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.291043:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e35d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.291049:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e35d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.291068:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783350062.291659:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783350062.291667:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.291677:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd600 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.291681:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.291699:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.291716:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.291725:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e72f485/0xd05e6ae1590e35d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.291740:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350062.291743:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e35d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.291750:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.291753:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e35d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.291761:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e35d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.291770:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e35d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.291777:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077800e65/0xd05e6ae1590e35d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.291809:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.291811:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.291813:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.293768:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.293784:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e35df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.293801:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.293811:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.293818:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e35df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.293832:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e35df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.293841:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e35df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.293849:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e35df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.293874:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783350062.294680:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.294688:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e35e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294700:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.294703:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.294707:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e35e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294718:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e35e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294725:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e35e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294738:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e35e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294756:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783350062.294767:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783350062.294772:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e35df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294779:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.294783:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e35df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294793:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e35df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294809:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e35df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294816:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e35df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294829:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.294832:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e35e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294849:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cce00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.294852:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e35e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294860:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e35e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294870:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e35e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294877:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e35e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.294891:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.294893:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.294894:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.295581:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.295589:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed0eb114/0xd05e6ae1590e35ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.295599:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.295602:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.295606:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed0eb114/0xd05e6ae1590e35ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.295616:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed0eb114/0xd05e6ae1590e35ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.295630:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed0eb114/0xd05e6ae1590e35ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.295638:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed0eb114/0xd05e6ae1590e35ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.295653:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.295662:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.295665:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed0eb114/0xd05e6ae1590e35ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.295671:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cdc00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.295674:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed0eb114/0xd05e6ae1590e35ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.295682:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed0eb114/0xd05e6ae1590e35ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.295693:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed0eb114/0xd05e6ae1590e35ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.295699:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed0eb114/0xd05e6ae1590e35ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.295712:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.295719:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.295720:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.295996:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783350062.296404:0:19408:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1783350062.296440:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783350062.296441:0:19408:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1783350062.296448:0:19408:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783350062.296646:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17832:x1869977659567872:12345-0@lo:5:osp-pre-1-1.0 Request processed in 92204us (93058us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783350062.296657:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783350062.296863:0:17832:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783350062.296873:0:17832:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37913aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17832:1869977659567872:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783350062.296887:0:17832:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1783350062.296934:0:17832:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17832:1869977659568000:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1783350062.296970:0:17832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350062.296999:0:17832:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea350832240 going to sleep for 11 seconds 00002000:00010000:3.0:1783350062.297366:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.297374:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be424a33/0xd05e6ae1590e35f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.297387:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.297390:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.297395:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be424a33/0xd05e6ae1590e35f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.297406:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be424a33/0xd05e6ae1590e35f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.297415:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be424a33/0xd05e6ae1590e35f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.297422:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be424a33/0xd05e6ae1590e35f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.297438:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.297608:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.297613:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be424a33/0xd05e6ae1590e35f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.297620:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cde00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.297624:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be424a33/0xd05e6ae1590e35f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.297643:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be424a33/0xd05e6ae1590e35f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.297657:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be424a33/0xd05e6ae1590e35f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.297665:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be424a33/0xd05e6ae1590e35f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.297682:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.297684:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.297686:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350062.297702:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659568000 00000100:00100000:2.0:1783350062.297711:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659568000 00000100:00100000:2.0:1783350062.297764:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00002000:00010000:0.0:1783350062.297769:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783350062.297776:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17832:x1869977659568000:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1783350062.297778:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e35fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.297790:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1783350062.297792:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350062.297797:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e35fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.297807:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e35fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.297826:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e35fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.297834:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e35fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350062.297844:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17832:x1869977659568000:12345-0@lo:900:osp-pre-1-1.0 Request processed in 71us (873us total) trans 0 rc 0/0 00010000:00010000:0.0:1783350062.297851:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783350062.297855:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783350062.297863:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350062.297869:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e35fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.297876:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350062.297880:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e35fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.297886:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e35fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1783350062.297892:0:17832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea24477f480 x1869977659568000/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783350078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783350062.297900:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e35fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350062.297911:0:17832:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17832:1869977659568000:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1783350062.297911:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e35fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.297933:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.297941:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.297945:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350062.298650:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350062.298657:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3602 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.298667:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1783350062.298670:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350062.298674:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.298683:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.298691:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.298699:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3602 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.298720:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783350062.298897:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.298903:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000533a073d/0xd05e6ae1590e3609 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.298911:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.298914:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.298918:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000533a073d/0xd05e6ae1590e3609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.298927:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000533a073d/0xd05e6ae1590e3609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.298934:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000533a073d/0xd05e6ae1590e3609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.298946:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000533a073d/0xd05e6ae1590e3609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.298967:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783350062.299430:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783350062.299438:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3602 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.299460:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.299463:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3602 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.299472:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3602 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.299487:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3602 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.299494:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089ae184e/0xd05e6ae1590e3602 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.299510:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350062.299515:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000533a073d/0xd05e6ae1590e3609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.299521:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.299524:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000533a073d/0xd05e6ae1590e3609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.299531:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000533a073d/0xd05e6ae1590e3609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.299541:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000533a073d/0xd05e6ae1590e3609 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.299554:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000533a073d/0xd05e6ae1590e3609 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.299566:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.299568:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.299569:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.300531:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350062.301047:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350062.301058:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000143ba0e1/0xd05e6ae1590e3610 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.301073:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1783350062.301077:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350062.301084:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000143ba0e1/0xd05e6ae1590e3610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.301096:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000143ba0e1/0xd05e6ae1590e3610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.301107:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000143ba0e1/0xd05e6ae1590e3610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.301116:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000143ba0e1/0xd05e6ae1590e3610 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.301149:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350062.301160:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350062.301165:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000143ba0e1/0xd05e6ae1590e3610 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.301184:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.301378:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000143ba0e1/0xd05e6ae1590e3610 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.301388:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000143ba0e1/0xd05e6ae1590e3610 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.301404:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000143ba0e1/0xd05e6ae1590e3610 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.301412:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000143ba0e1/0xd05e6ae1590e3610 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.301428:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.301429:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.301431:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783350062.302101:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783350062.302110:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e3617 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.302124:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1783350062.302127:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350062.302132:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e3617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.302160:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e3617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.302170:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e3617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.302178:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e3617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.302199:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.302257:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.302265:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e3617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.302272:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.302276:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e3617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.302283:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e3617 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.302296:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e3617 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.302303:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000331cd105/0xd05e6ae1590e3617 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.302327:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.302329:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.302331:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.303393:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.303411:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed0eb114/0xd05e6ae1590e361e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.303424:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.303427:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.303432:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed0eb114/0xd05e6ae1590e361e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.303443:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed0eb114/0xd05e6ae1590e361e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.303452:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed0eb114/0xd05e6ae1590e361e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.303459:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed0eb114/0xd05e6ae1590e361e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.303477:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783350062.303957:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.303972:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e3625 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.303981:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.303984:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.303988:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e3625 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.303999:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e3625 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.304014:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e3625 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.304021:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e3625 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.304036:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783350062.304937:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783350062.304956:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed0eb114/0xd05e6ae1590e361e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.304968:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cdc00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.304972:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed0eb114/0xd05e6ae1590e361e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.304982:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed0eb114/0xd05e6ae1590e361e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.305008:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed0eb114/0xd05e6ae1590e361e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.305016:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed0eb114/0xd05e6ae1590e361e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.305035:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350062.305038:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e3625 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.305045:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cce00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.305048:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e3625 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.305056:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e3625 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.305066:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e3625 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.305073:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3b56e1/0xd05e6ae1590e3625 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.305084:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.305085:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.305092:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.305631:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.305782:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.305790:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e362c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.305803:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.305807:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.305812:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e362c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.305823:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e362c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.305832:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e362c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.305839:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e362c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.305868:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.305877:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.305882:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e362c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.305889:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.305892:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e362c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.305901:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e362c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.305913:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e362c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.305920:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3e216ae/0xd05e6ae1590e362c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.305934:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.305936:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.305937:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783350062.306078:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350062.306099:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e3633 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.306107:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1783350062.306116:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350062.306120:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e3633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.306129:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e3633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.306164:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e3633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.306172:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e3633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.306185:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783350062.306354:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783350062.306360:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e3633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.306368:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350062.306372:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e3633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.306380:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e3633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.306392:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e3633 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.306398:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ca59d6/0xd05e6ae1590e3633 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.306411:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.306413:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.306414:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.307712:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.307724:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be424a33/0xd05e6ae1590e363a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.307737:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.307746:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.307750:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be424a33/0xd05e6ae1590e363a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.307761:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be424a33/0xd05e6ae1590e363a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.307770:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be424a33/0xd05e6ae1590e363a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.307778:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be424a33/0xd05e6ae1590e363a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.307801:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350062.308491:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350062.308506:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be424a33/0xd05e6ae1590e363a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.308517:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cde00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.308521:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be424a33/0xd05e6ae1590e363a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.308530:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be424a33/0xd05e6ae1590e363a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.308545:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be424a33/0xd05e6ae1590e363a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.308553:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be424a33/0xd05e6ae1590e363a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.308619:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.308621:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.308623:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783350062.311223:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783350062.311237:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000511f2748/0xd05e6ae1590e3641 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.311253:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=503s v=(0 0) 00010000:00010000:3.0:1783350062.311257:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783350062.311264:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000511f2748/0xd05e6ae1590e3641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.311277:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000511f2748/0xd05e6ae1590e3641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.311286:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000511f2748/0xd05e6ae1590e3641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.311308:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000511f2748/0xd05e6ae1590e3641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.311341:0:18594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783350062.311412:0:18594:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1783350062.311504:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17114:x1869977659567360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 140619us (142616us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350062.311515:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00010000:0.0:1783350062.311739:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783350062.311747:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e3648 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.311754:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1783350062.311757:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350062.311760:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e3648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.311770:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e3648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.311777:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e3648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.311790:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e3648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.311806:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783350062.312597:0:17114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17114:1869977659567360:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783350062.312616:0:17114:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1783350062.312664:0:17114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17114:1869977659568128:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783350062.312711:0:17114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350062.312737:0:17114:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea2410e73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350062.312756:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659568128 00000100:00100000:2.0:1783350062.312762:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659568128 00000100:00100000:2.0:1783350062.312807:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783350062.312815:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17114:x1869977659568128:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783350062.312851:0:19278:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1783350062.312947:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783350062.312954:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000511f2748/0xd05e6ae1590e3641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.312966:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.312971:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000511f2748/0xd05e6ae1590e3641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.312980:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000511f2748/0xd05e6ae1590e3641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.312998:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000511f2748/0xd05e6ae1590e3641 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.313005:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000511f2748/0xd05e6ae1590e3641 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.313024:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350062.313027:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e3648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.313033:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364a200 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350062.313036:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e3648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.313053:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e3648 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.313063:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e3648 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.313071:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da0bd3b5/0xd05e6ae1590e3648 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350062.313083:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.313085:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350062.313086:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350062.315006:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350062.316634:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350062.316648:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000143ba0e1/0xd05e6ae1590e364f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.316666:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1783350062.316671:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350062.316690:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000143ba0e1/0xd05e6ae1590e364f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.316705:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000143ba0e1/0xd05e6ae1590e364f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.316715:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000143ba0e1/0xd05e6ae1590e364f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.316723:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000143ba0e1/0xd05e6ae1590e364f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.316748:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350062.318216:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350062.318228:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000143ba0e1/0xd05e6ae1590e364f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.318239:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350062.318243:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000143ba0e1/0xd05e6ae1590e364f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.318253:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000143ba0e1/0xd05e6ae1590e364f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.318271:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000143ba0e1/0xd05e6ae1590e364f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.318278:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000143ba0e1/0xd05e6ae1590e364f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.318300:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.318302:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.318303:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350062.318583:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350062.318592:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49ae38f/0xd05e6ae1590e3656 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.318603:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1783350062.318607:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350062.318612:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49ae38f/0xd05e6ae1590e3656 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.318622:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49ae38f/0xd05e6ae1590e3656 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.318631:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49ae38f/0xd05e6ae1590e3656 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.318656:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49ae38f/0xd05e6ae1590e3656 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.318682:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.318860:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.318867:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49ae38f/0xd05e6ae1590e3656 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.318880:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c000 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.318883:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49ae38f/0xd05e6ae1590e3656 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.318890:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49ae38f/0xd05e6ae1590e3656 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.318902:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49ae38f/0xd05e6ae1590e3656 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.318909:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49ae38f/0xd05e6ae1590e3656 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.318938:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.318940:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.318942:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350062.319699:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350062.319708:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc39b1cd/0xd05e6ae1590e365d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.319720:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1783350062.319723:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350062.319728:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc39b1cd/0xd05e6ae1590e365d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.319739:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc39b1cd/0xd05e6ae1590e365d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.319747:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc39b1cd/0xd05e6ae1590e365d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.319754:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc39b1cd/0xd05e6ae1590e365d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.319778:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783350062.319942:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.319948:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc39b1cd/0xd05e6ae1590e365d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.319957:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.319961:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc39b1cd/0xd05e6ae1590e365d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.319969:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc39b1cd/0xd05e6ae1590e365d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.319992:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc39b1cd/0xd05e6ae1590e365d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.320000:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc39b1cd/0xd05e6ae1590e365d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.320019:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.320022:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.320024:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350062.320414:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350062.320420:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2697988/0xd05e6ae1590e3664 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.320434:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1783350062.320438:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350062.320441:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2697988/0xd05e6ae1590e3664 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.320450:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2697988/0xd05e6ae1590e3664 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.320457:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2697988/0xd05e6ae1590e3664 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.320463:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2697988/0xd05e6ae1590e3664 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.320475:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783350062.320594:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350062.320602:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2697988/0xd05e6ae1590e3664 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.320619:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8da00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:0.0:1783350062.320622:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2697988/0xd05e6ae1590e3664 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.320631:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2697988/0xd05e6ae1590e3664 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.320642:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2697988/0xd05e6ae1590e3664 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.320649:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2697988/0xd05e6ae1590e3664 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350062.320661:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.320663:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350062.320664:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783350062.320987:0:19527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783350062.320993:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b3fda63/0xd05e6ae1590e366b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.321000:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1783350062.321003:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350062.321007:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b3fda63/0xd05e6ae1590e366b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.321016:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b3fda63/0xd05e6ae1590e366b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.321035:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b3fda63/0xd05e6ae1590e366b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.321042:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b3fda63/0xd05e6ae1590e366b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350062.321253:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783350062.321298:0:19527:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1783350062.321398:0:19527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17112:x1869977659567616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 136565us (141310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350062.321407:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783350062.322674:0:17112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17112:1869977659567616:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783350062.322691:0:17112:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1783350062.322738:0:17112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17112:1869977659568256:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783350062.322789:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350062.322820:0:17112:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350062.322826:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659568256 00000100:00100000:2.0:1783350062.322835:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659568256 00000100:00100000:2.0:1783350062.322888:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783350062.322897:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17112:x1869977659568256:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783350062.322935:0:18596:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1783350062.329422:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783350062.329435:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b3fda63/0xd05e6ae1590e366b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.329462:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8de00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350062.329467:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b3fda63/0xd05e6ae1590e366b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.329479:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b3fda63/0xd05e6ae1590e366b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.329500:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b3fda63/0xd05e6ae1590e366b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.329508:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b3fda63/0xd05e6ae1590e366b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350062.329527:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.329529:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350062.329532:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350062.342883:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17114:x1869977659568128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 30061us (30164us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783350062.342896:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783350062.343864:0:17114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17114:1869977659568128:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783350062.343881:0:17114:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:00080000:0.0:1783350062.346557:0:18590:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1783350062.346614:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783350062.346800:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17112:x1869977659568256:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23901us (24007us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783350062.346811:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783350062.347193:0:17112:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1783350062.347203:0:17112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17112:1869977659568256:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783350062.347220:0:17112:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:3.0:1783350062.468775:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783350062.468799:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659568384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783350062.468865:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350062.468909:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659568384 00000100:00100000:3.0:1783350062.468916:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659568384 00000100:00100000:3.0:1783350062.468954:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783350062.468961:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659568384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783350062.468995:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783350062.469034:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659568384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350062.469041:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783350062.469079:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659568384:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783350062.788727:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350062.980515:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783350062.980537:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659568512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350062.980605:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350062.980659:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659568512 00000100:00100000:2.0:1783350062.980666:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659568512 00000100:00100000:2.0:1783350062.980711:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783350062.980719:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659568512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350062.980752:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783350062.980806:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659568512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350062.980813:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783350062.980857:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659568512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783350062.981052:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659568640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350062.981085:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350062.981157:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659568640 00000100:00100000:2.0:1783350062.981161:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659568640 00000100:00100000:2.0:1783350062.981185:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783350062.981191:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659568640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783350062.981206:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350062.981239:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659568640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350062.981245:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783350062.981271:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659568640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783350063.815651:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350064.836327:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783350064.964782:0:17847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783350065.860486:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350066.884331:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783350067.563870:0:19780:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783350067.589379:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659568768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783350067.589447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589505:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659569280:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589545:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659569792:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589563:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589576:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659570304:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589595:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589617:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1783350067.589622:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659568896:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589668:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659569408:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589696:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659569920:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589722:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659570432:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589736:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589757:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659569024:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589777:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589790:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659569536:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589814:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659570048:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589829:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589838:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783350067.589842:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659569152:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589856:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589867:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659569664:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589897:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659570176:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.589914:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.589951:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659568768 00000100:00100000:2.0:1783350067.589958:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659568768 00000100:00100000:2.0:1783350067.590003:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350067.590011:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869977659568768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783350067.590044:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783350067.590080:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869977659568768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590087:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350067.590104:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659569280 00000100:00100000:2.0:1783350067.590107:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659569280 00000100:00100000:2.0:1783350067.590123:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659569792 00000100:00100000:2.0:1783350067.590125:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659569792 00000100:00100000:2.0:1783350067.590156:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659569152 00000100:00100000:2.0:1783350067.590158:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659569152 00000100:00100000:2.0:1783350067.590169:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659569664 00000100:00100000:2.0:1783350067.590170:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659569664 00000100:00100000:2.0:1783350067.590181:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783350067.590186:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869977659569280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590213:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869977659569280:12345-0@lo:400:kworker.0 Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590219:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783350067.590227:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783350067.590233:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659569792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590252:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659569792:12345-0@lo:400:kworker.0 Request processed in 19us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590257:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783350067.590264:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783350067.590269:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659569152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590306:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659569152:12345-0@lo:400:kworker.0 Request processed in 37us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590311:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783350067.590326:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350067.590331:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659569664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590352:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659569664:12345-0@lo:400:kworker.0 Request processed in 22us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590358:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783350067.590371:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659570304 00000100:00100000:2.0:1783350067.590375:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659570304 00000100:00100000:2.0:1783350067.590389:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659569408 00000100:00100000:2.0:1783350067.590392:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659569408 00000100:00100000:2.0:1783350067.590399:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659569920 00000100:00100000:2.0:1783350067.590401:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659569920 00000100:00100000:2.0:1783350067.590409:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659570432 00000100:00100000:2.0:1783350067.590410:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659570432 00000100:00100000:2.0:1783350067.590418:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659570048 00000100:00100000:2.0:1783350067.590420:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659570048 00000100:00100000:2.0:1783350067.590428:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659570176 00000100:00100000:2.0:1783350067.590430:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659570176 00000100:00100000:2.0:1783350067.590440:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783350067.590445:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659570304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590469:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659570304:12345-0@lo:400:kworker.0 Request processed in 24us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590474:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783350067.590485:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783350067.590490:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659569408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590514:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659569408:12345-0@lo:400:kworker.0 Request processed in 24us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590519:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783350067.590529:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783350067.590534:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659569920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590567:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659569920:12345-0@lo:400:kworker.0 Request processed in 34us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590573:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783350067.590584:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783350067.590589:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659570432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590612:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659570432:12345-0@lo:400:kworker.0 Request processed in 23us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590616:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783350067.590626:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783350067.590631:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659570048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590652:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659570048:12345-0@lo:400:kworker.0 Request processed in 21us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590657:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783350067.590665:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783350067.590670:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659570176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590691:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869977659570176:12345-0@lo:400:kworker.0 Request processed in 21us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590695:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783350067.590711:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659568896 00000100:00100000:2.0:1783350067.590713:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659568896 00000100:00100000:2.0:1783350067.590737:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783350067.590742:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3646:x1869977659568896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590768:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3646:x1869977659568896:12345-0@lo:400:kworker.0 Request processed in 27us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590773:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783350067.590817:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659569024 00000100:00100000:2.0:1783350067.590820:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659569024 00000100:00100000:2.0:1783350067.590849:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659569536 00000100:00100000:2.0:1783350067.590852:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659569536 00000100:00100000:2.0:1783350067.590864:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783350067.590869:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659569024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590898:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659569024:12345-0@lo:400:kworker.0 Request processed in 28us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590904:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783350067.590914:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783350067.590920:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659569536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.590945:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659569536:12345-0@lo:400:kworker.0 Request processed in 25us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.590950:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1783350067.590971:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783350067.590974:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783350067.590977:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783350067.590979:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783350067.591013:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659569152:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.591025:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659569664:0@lo:400:kworker.0 00010000:00080000:2.0:1783350067.591036:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370d66680 x1869977659570176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350067.591046:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869977659570176:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.591056:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659569024:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.591063:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659569536:0@lo:400:kworker.0 00010000:00080000:2.0:1783350067.591080:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370d67480 x1869977659570048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350067.591088:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659570048:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.591124:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3646:1869977659568896:0@lo:400:kworker.0 00010000:00080000:2.0:1783350067.591132:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243083b80 x1869977659569408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350067.591160:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659569408:0@lo:400:kworker.0 00010000:00080000:2.0:1783350067.591169:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370d67b80 x1869977659569920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350067.591177:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659569920:0@lo:400:kworker.0 00010000:00080000:2.0:1783350067.591186:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370d65500 x1869977659570432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350067.591193:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659570432:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.591206:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659568768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783350067.591213:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659569280:0@lo:400:kworker.0 00000100:00100000:2.0:1783350067.591221:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659569792:0@lo:400:kworker.0 00010000:00080000:2.0:1783350067.591230:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370d65c00 x1869977659570304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350067.591237:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659570304:0@lo:400:kworker.0 00000100:00100000:1.0:1783350067.592326:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783350067.592339:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659570560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783350067.592380:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350067.592419:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659570560 00000100:00100000:1.0:1783350067.592424:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659570560 00000100:00100000:1.0:1783350067.592459:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783350067.592465:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659570560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783350067.592481:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350067.592656:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37913aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659570560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 191us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350067.592663:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783350067.592709:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783350067.592716:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659570688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783350067.592738:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350067.592764:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659570688 00000100:00100000:1.0:1783350067.592767:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659570688 00000100:00100000:1.0:1783350067.592783:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783350067.592788:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659570688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783350067.592802:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783350067.592826:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659570688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350067.592831:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783350067.592857:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659570688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783350067.592964:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783350067.592981:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659570816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783350067.593006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350067.593028:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659570816 00000100:00100000:2.0:1783350067.593031:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659570816 00000100:00100000:2.0:1783350067.593052:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783350067.593057:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659570816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783350067.593066:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783350067.593092:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659570816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350067.593098:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783350067.593123:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659570816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783350067.596769:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea379138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659570560:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783350067.908922:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350068.106772:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783350068.106793:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659570944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783350068.106854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350068.111176:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659570944 00000100:00100000:2.0:1783350068.111193:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659570944 00000100:00100000:2.0:1783350068.111436:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783350068.111450:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659570944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350068.111489:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783350068.111582:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659570944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (4726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350068.111590:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783350068.111645:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659570944:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1783350068.113737:0:19408:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1783350068.123697:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783350068.123720:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659571072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350068.123788:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350068.123838:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659571072 00000100:00100000:0.0:1783350068.123845:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659571072 00000100:00100000:0.0:1783350068.123888:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783350068.123896:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659571072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783350068.123928:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350068.123971:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659571072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350068.123978:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783350068.124024:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659571072:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1783350068.453048:0:19832:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783350068.453328:0:19832:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783350068.932987:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783350069.386114:0:19883:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783350069.386895:0:19883:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783350069.712526:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350069.712653:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642715520 00000100:00100000:0.0:1783350069.712663:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642715520 00000100:00100000:0.0:1783350069.712707:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 114 00000100:00100000:0.0:1783350069.712715:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2398:x1869977642715520:12345-192.168.203.50@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783350069.712741:0:17081:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 02fc5821-de16-4655-b2ee-a46099f9f1d8@192.168.203.50@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1783350069.712768:0:17081:0:(genops.c:1406:class_connect()) connect: client 02fc5821-de16-4655-b2ee-a46099f9f1d8, cookie 0xd05e6ae1590e3672 00000100:00080000:0.0:1783350069.712880:0:17081:0:(import.c:65:import_set_state_nolock()) ffff8ea36739d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350069.712944:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+5:2398:x1869977642715520:12345-192.168.203.50@tcp:250:mount.lustre.0 Request processed in 228us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350069.712963:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 114 00000100:00100000:1.0:1783350069.725790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350069.725958:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642715648 00000100:00100000:2.0:1783350069.725968:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642715648 00000100:00100000:2.0:1783350069.726026:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:2.0:1783350069.726036:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+5:14880:x1869977642715648:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783350069.726066:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350069.726084:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3679 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded253 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350069.726113:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded253 expref: 6 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350069.726420:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8e200/0xd05e6ae1590e3679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded253 expref: 6 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350069.726432:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e200, rc 0) 00000100:00100000:2.0:1783350069.726495:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+6:14880:x1869977642715648:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 460us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350069.726502:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:3.0:1783350069.735046:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350069.735175:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642715776 00000100:00100000:0.0:1783350069.735352:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642715776 00000100:00100000:0.0:1783350069.735415:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:0.0:1783350069.735425:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+6:14880:x1869977642715776:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783350069.735721:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+6:14880:x1869977642715776:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 296us (696us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783350069.735729:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:3.0:1783350069.738732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350069.738824:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642715904 00000100:00100000:2.0:1783350069.738834:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642715904 00000100:00100000:2.0:1783350069.738885:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 117 00000100:00100000:2.0:1783350069.738895:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+6:14880:x1869977642715904:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783350069.738912:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350069.738928:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e3680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded25a expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350069.738955:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e3680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded25a expref: 7 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350069.738966:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8fc00/0xd05e6ae1590e3680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded25a expref: 7 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350069.739003:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8fc00, rc 0) 00000100:00100000:2.0:1783350069.739077:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+7:14880:x1869977642715904:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 183us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350069.739085:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 117 00000100:00100000:1.0:1783350069.743469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350069.743556:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642716032 00000100:00100000:0.0:1783350069.743566:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642716032 00000100:00100000:0.0:1783350069.743682:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 118 00000100:00100000:0.0:1783350069.743693:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+7:14880:x1869977642716032:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783350069.743845:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:14880:x1869977642716032:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 153us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350069.743853:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 118 00000100:00100000:0.0:1783350069.748998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350069.749067:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642716160 00000100:00100000:3.0:1783350069.749076:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642716160 00000100:00100000:3.0:1783350069.749164:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 119 00000100:00100000:3.0:1783350069.749174:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:14880:x1869977642716160:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783350069.749454:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:14880:x1869977642716160:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 280us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350069.749462:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 119 00000100:00100000:3.0:1783350069.759523:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350069.759603:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642716288 00000100:00100000:0.0:1783350069.759613:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642716288 00000100:00100000:0.0:1783350069.759664:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:0.0:1783350069.759674:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:14899:x1869977642716288:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783350069.759826:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:14899:x1869977642716288:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 152us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350069.759834:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:1.0:1783350069.793472:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350069.793682:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642716416 00000100:00100000:2.0:1783350069.793693:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642716416 00000100:00100000:2.0:1783350069.793761:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:2.0:1783350069.793775:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:14899:x1869977642716416:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783350069.793969:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:14899:x1869977642716416:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 197us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350069.793978:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:1.0:1783350069.799288:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350069.799438:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642716544 00000100:00100000:3.0:1783350069.799448:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642716544 00000100:00100000:3.0:1783350069.799502:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:3.0:1783350069.799512:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:14899:x1869977642716544:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783350069.802843:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:14899:x1869977642716544:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 3323us (3554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350069.802858:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:3.0:1783350069.807391:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350069.807539:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642716672 00000100:00100000:2.0:1783350069.807548:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642716672 00000100:00100000:2.0:1783350069.807606:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:2.0:1783350069.807616:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea342d1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+8:14880:x1869977642716672:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783350069.807632:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350069.807648:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e3687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded28b expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350069.807676:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e3687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded28b expref: 9 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350069.807686:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8f400/0xd05e6ae1590e3687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded28b expref: 9 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350069.807696:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f400, rc 0) 00000100:00100000:2.0:1783350069.807765:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea342d1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+9:14880:x1869977642716672:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 150us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350069.807772:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:1.0:1783350069.811752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350069.811829:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642716800 00000100:00100000:3.0:1783350069.811838:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642716800 00000100:00100000:3.0:1783350069.811890:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 124 00000100:00100000:3.0:1783350069.811899:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+9:14880:x1869977642716800:12345-192.168.203.50@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783350069.811921:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783350069.811944:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783350069.811948:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783350069.811952:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783350069.811955:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1783350069.811957:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1783350069.814387:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+9:14880:x1869977642716800:12345-192.168.203.50@tcp:256:mount.lustre.0 Request processed in 2480us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350069.814400:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 124 00000100:00100000:1.0:1783350069.817191:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350069.817366:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642716928 00000100:00100000:0.0:1783350069.817380:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642716928 00000100:00100000:0.0:1783350069.817469:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00100000:0.0:1783350069.817485:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+9:14880:x1869977642716928:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783350069.817503:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350069.817518:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e368e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded292 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350069.817545:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e368e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded292 expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350069.817556:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e368e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded292 expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350069.817565:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a200, rc 0) 00000100:00100000:0.0:1783350069.817617:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:14880:x1869977642716928:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 139us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350069.817624:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00100000:1.0:1783350069.819299:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350069.819679:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642717056 00000100:00100000:2.0:1783350069.819688:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642717056 00000100:00100000:2.0:1783350069.819725:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:2.0:1783350069.819733:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:14880:x1869977642717056:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783350069.819887:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:14880:x1869977642717056:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 153us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350069.819895:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:1.0:1783350069.822002:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350069.822339:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642717184 00000100:00100000:2.0:1783350069.822347:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642717184 00000100:00100000:2.0:1783350069.822442:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 127 00000100:00100000:2.0:1783350069.822454:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:14880:x1869977642717184:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783350069.822602:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:14880:x1869977642717184:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 150us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350069.822611:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 127 00000100:00100000:1.0:1783350069.825352:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350069.825666:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642717312 00000100:00100000:3.0:1783350069.825675:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642717312 00000100:00100000:3.0:1783350069.825733:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 128 00000100:00100000:3.0:1783350069.825743:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:14903:x1869977642717312:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783350069.825925:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:14903:x1869977642717312:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 182us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350069.825934:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 128 00000100:00100000:1.0:1783350069.829747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350069.829874:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642717440 00000100:00100000:3.0:1783350069.829884:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642717440 00000100:00100000:3.0:1783350069.829949:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 129 00000100:00100000:3.0:1783350069.829958:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:14903:x1869977642717440:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783350069.830540:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:14903:x1869977642717440:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 521us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350069.830550:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 129 00000100:00100000:1.0:1783350069.839045:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350069.839158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350069.842337:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642717568 00000100:00100000:2.0:1783350069.842352:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642717568 00000100:00100000:2.0:1783350069.842487:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642717824 00000100:00100000:2.0:1783350069.842491:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642717824 00000100:00100000:3.0:1783350069.842531:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1783350069.842540:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1869977642717568:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783350069.842571:0:19423:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8a2801b7-a361-434c-b0c3-f6ccaa904300@192.168.203.50@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1783350069.842623:0:19423:0:(genops.c:1406:class_connect()) connect: client 8a2801b7-a361-434c-b0c3-f6ccaa904300, cookie 0xd05e6ae1590e3695 00000004:00100000:3.0:1783350069.842649:0:19423:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783350069.842840:0:19423:0:(import.c:65:import_set_state_nolock()) ffff8ea2435c7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783350069.842920:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2398:x1869977642717568:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 378us (3883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350069.842929:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1783350069.842946:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:3.0:1783350069.842951:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1869977642717824:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783350069.842966:0:19423:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 8a2801b7-a361-434c-b0c3-f6ccaa904300@192.168.203.50@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1783350069.842996:0:19423:0:(genops.c:1406:class_connect()) connect: client 8a2801b7-a361-434c-b0c3-f6ccaa904300, cookie 0xd05e6ae1590e369c 00000004:00100000:3.0:1783350069.843009:0:19423:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783350069.843167:0:19423:0:(import.c:65:import_set_state_nolock()) ffff8ea2435c3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783350069.843194:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2398:x1869977642717824:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 241us (4036us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350069.843201:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:1.0:1783350069.851929:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350069.852016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350069.852737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350069.852796:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642717696 00000100:00100000:0.0:1783350069.852806:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642717696 00000100:00100000:0.0:1783350069.852876:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642717952 00000100:00100000:0.0:1783350069.852879:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642717952 00000100:00100000:0.0:1783350069.852907:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:0.0:1783350069.852916:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:0:x1869977642717696:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783350069.852954:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783350069.853045:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:0:x1869977642717696:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 129us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350069.853063:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:0.0:1783350069.853082:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1783350069.853102:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:0:x1869977642717952:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783350069.853120:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350069.853181:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:0:x1869977642717952:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 80us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350069.853188:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00080000:3.0:1783350069.853451:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783350069.853456:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783350069.853893:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642718080 00000100:00100000:0.0:1783350069.853899:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642718080 00000100:00100000:0.0:1783350069.853934:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:0.0:1783350069.853942:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14880:x1869977642718080:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783350069.853972:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783350069.854001:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14880:x1869977642718080:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 60us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350069.854022:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:1.0:1783350069.856495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350069.856614:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642718208 00000100:00100000:0.0:1783350069.856622:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642718208 00000100:00100000:0.0:1783350069.856680:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:0.0:1783350069.856689:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14880:x1869977642718208:12345-192.168.203.50@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783350069.856765:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14880:x1869977642718208:12345-192.168.203.50@tcp:40:mount.lustre.0 Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350069.856772:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:1.0:1783350069.858742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350069.858830:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642718336 00000100:00100000:2.0:1783350069.858839:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642718336 00000100:00100000:2.0:1783350069.858883:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:2.0:1783350069.858902:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1869977642718336:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783350069.858932:0:18595:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8a2801b7-a361-434c-b0c3-f6ccaa904300@192.168.203.50@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1783350069.858963:0:18595:0:(genops.c:1406:class_connect()) connect: client 8a2801b7-a361-434c-b0c3-f6ccaa904300, cookie 0xd05e6ae1590e36a3 00002000:00100000:2.0:1783350069.858974:0:18595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8a2801b7-a361-434c-b0c3-f6ccaa904300/ffff8ea241d27000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783350069.858992:0:18595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783350069.859392:0:18595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783350069.859422:0:18595:0:(import.c:65:import_set_state_nolock()) ffff8ea241d23000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783350069.859550:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2398:x1869977642718336:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 645us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350069.859559:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:1.0:1783350069.862499:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350069.862534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350069.862611:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642718592 00000100:00100000:3.0:1783350069.862620:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642718592 00000100:00100000:3.0:1783350069.862675:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:3.0:1783350069.862698:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14880:x1869977642718592:12345-192.168.203.50@tcp:900:mount.lustre.0 00000100:00100000:3.0:1783350069.862788:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14880:x1869977642718592:12345-192.168.203.50@tcp:900:mount.lustre.0 Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350069.862795:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1783350069.862963:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642718464 00000100:00100000:0.0:1783350069.862968:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642718464 00000100:00100000:0.0:1783350069.862998:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:0.0:1783350069.863004:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1869977642718464:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783350069.863029:0:18594:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8a2801b7-a361-434c-b0c3-f6ccaa904300@192.168.203.50@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1783350069.863075:0:18594:0:(genops.c:1406:class_connect()) connect: client 8a2801b7-a361-434c-b0c3-f6ccaa904300, cookie 0xd05e6ae1590e36aa 00002000:00100000:0.0:1783350069.863086:0:18594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8a2801b7-a361-434c-b0c3-f6ccaa904300/ffff8ea36739f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783350069.863102:0:18594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783350069.863468:0:18594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783350069.863495:0:18594:0:(import.c:65:import_set_state_nolock()) ffff8ea367399800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350069.863542:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2398:x1869977642718464:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 536us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350069.863550:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:1.0:1783350069.867189:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350069.868619:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642718720 00000100:00100000:0.0:1783350069.868632:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642718720 00000100:00100000:0.0:1783350069.868689:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:0.0:1783350069.868698:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14880:x1869977642718720:12345-192.168.203.50@tcp:33:mount.lustre.0 00000004:00080000:1.0:1783350069.870440:0:17090:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1661us 00000004:00200000:1.0:1783350069.887244:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783350069.887385:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14880:x1869977642718720:12345-192.168.203.50@tcp:33:mount.lustre.0 Request processed in 18682us (20199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350069.887400:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000040:00080000:1.0:1783350069.896121:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783350069.956309:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350070.076244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350070.076347:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642718848 00000100:00100000:2.0:1783350070.076356:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642718848 00000100:00100000:2.0:1783350070.076410:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:2.0:1783350070.076418:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14926:x1869977642718848:12345-192.168.203.50@tcp:101:mkdir.0 00010000:00010000:2.0:1783350070.076436:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350070.076459:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e800/0xd05e6ae1590e36b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded2c3 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350070.076527:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e36b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350070.076541:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e36b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350070.076554:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e36b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350070.076620:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783350070.076624:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350070.076656:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e36b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350070.076681:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e800/0xd05e6ae1590e36b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded2c3 expref: 8 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350070.076699:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e36b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded2c3 expref: 7 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350070.076707:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c4400) 00010000:00010000:2.0:1783350070.076710:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783350070.076713:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f000, rc 0) 00000100:00100000:2.0:1783350070.076768:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:14926:x1869977642718848:12345-192.168.203.50@tcp:101:mkdir.0 Request processed in 350us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350070.076775:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00010000:00010000:3.0:1783350070.982899:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783350072.004414:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350072.172285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350072.172419:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642718976 00000100:00100000:0.0:1783350072.172430:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642718976 00000100:00100000:0.0:1783350072.172514:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:0.0:1783350072.172526:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:14978:x1869977642718976:12345-192.168.203.50@tcp:41:lfs.0 00000004:00000024:0.0:1783350072.172563:0:19423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783350072.172668:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:14978:x1869977642718976:12345-192.168.203.50@tcp:41:lfs.0 Request processed in 143us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350072.172675:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00080000:3.0:1783350072.173165:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783350072.175659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.175751:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642719104 00000100:00100000:2.0:1783350072.175760:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642719104 00000100:00100000:2.0:1783350072.175831:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:2.0:1783350072.175841:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14978:x1869977642719104:12345-192.168.203.50@tcp:41:lfs.0 00000004:00000024:2.0:1783350072.175876:0:17088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350072.175954:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14978:x1869977642719104:12345-192.168.203.50@tcp:41:lfs.0 Request processed in 115us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.175961:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00080000:3.0:1783350072.176074:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783350072.186328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.188026:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642719232 00000100:00100000:2.0:1783350072.188056:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642719232 00000100:00080000:3.0:1783350072.188682:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783350072.189267:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:2.0:1783350072.189284:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14978:x1869977642719232:12345-192.168.203.50@tcp:13:lfs.0 00002000:00000024:2.0:1783350072.189318:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783350072.189460:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14978:x1869977642719232:12345-192.168.203.50@tcp:13:lfs.0 Request processed in 182us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.189468:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:1.0:1783350072.203568:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.204836:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642719360 00000100:00100000:2.0:1783350072.204847:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642719360 00000100:00080000:3.0:1783350072.204931:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783350072.204932:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:2.0:1783350072.204945:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14978:x1869977642719360:12345-192.168.203.50@tcp:13:lfs.0 00002000:00000024:2.0:1783350072.204979:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783350072.205064:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:14978:x1869977642719360:12345-192.168.203.50@tcp:13:lfs.0 Request processed in 121us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.205072:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1783350072.558289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350072.558430:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642719488 00000100:00100000:3.0:1783350072.558440:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642719488 00000100:00100000:3.0:1783350072.558507:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:3.0:1783350072.558518:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24397b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+10:15014:x1869977642719488:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783350072.558536:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350072.558554:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e36bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded2ca expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350072.558585:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e36bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded2ca expref: 11 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350072.558597:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cc600/0xd05e6ae1590e36bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded2ca expref: 11 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350072.558607:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc600, rc 0) 00000100:00100000:3.0:1783350072.558670:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24397b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15014:x1869977642719488:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 153us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.558692:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:1.0:1783350072.563273:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.563371:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642719616 00000100:00100000:2.0:1783350072.563382:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642719616 00000100:00100000:2.0:1783350072.563441:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 131 00000100:00100000:2.0:1783350072.563451:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea34460b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15014:x1869977642719616:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783350072.563613:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea34460b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15014:x1869977642719616:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 162us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.563620:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 131 00000100:00100000:1.0:1783350072.572533:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350072.572830:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642719744 00000100:00100000:0.0:1783350072.572839:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642719744 00000100:00100000:0.0:1783350072.572905:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 132 00000100:00100000:0.0:1783350072.572916:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea344608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15014:x1869977642719744:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783350072.573053:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea344608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15014:x1869977642719744:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 138us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350072.573061:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 132 00000100:00100000:0.0:1783350072.575523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.578608:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642719872 00000100:00100000:2.0:1783350072.578623:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642719872 00000100:00100000:2.0:1783350072.578690:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:2.0:1783350072.578700:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15018:x1869977642719872:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783350072.578877:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15018:x1869977642719872:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 179us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.578886:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:1.0:1783350072.616713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350072.619035:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642720000 00000100:00100000:0.0:1783350072.619049:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642720000 00000100:00100000:0.0:1783350072.619110:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 134 00000100:00100000:0.0:1783350072.619119:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15018:x1869977642720000:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783350072.619329:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15018:x1869977642720000:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 209us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350072.619337:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 134 00000100:00100000:1.0:1783350072.630300:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350072.630436:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642720128 00000100:00100000:3.0:1783350072.630447:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642720128 00000100:00100000:3.0:1783350072.630512:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 135 00000100:00100000:3.0:1783350072.630523:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15018:x1869977642720128:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783350072.630664:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15018:x1869977642720128:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 142us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.630672:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 135 00000100:00100000:1.0:1783350072.650177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.653654:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642720256 00000100:00100000:2.0:1783350072.653668:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642720256 00000100:00100000:2.0:1783350072.653790:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 136 00000100:00100000:2.0:1783350072.653802:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:15014:x1869977642720256:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783350072.653819:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350072.653837:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8e800/0xd05e6ae1590e36c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded2fb expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.653868:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8e800/0xd05e6ae1590e36c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded2fb expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.653881:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8e800/0xd05e6ae1590e36c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded2fb expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.653890:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e800, rc 0) 00000100:00100000:2.0:1783350072.653956:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:15014:x1869977642720256:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 156us (3820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.653965:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 136 00000100:00100000:1.0:1783350072.672083:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350072.672159:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642720384 00000100:00100000:3.0:1783350072.672169:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642720384 00000100:00100000:3.0:1783350072.672240:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 137 00000100:00100000:3.0:1783350072.672252:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:15014:x1869977642720384:12345-192.168.203.50@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783350072.672278:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783350072.672303:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783350072.672308:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783350072.672311:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783350072.672314:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1783350072.672317:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1783350072.680548:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:15014:x1869977642720384:12345-192.168.203.50@tcp:256:mount.lustre.0 Request processed in 8289us (8465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.680561:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 137 00000100:00100000:1.0:1783350072.683095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.683173:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642720512 00000100:00100000:2.0:1783350072.683181:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642720512 00000100:00100000:2.0:1783350072.683244:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 138 00000100:00100000:2.0:1783350072.683253:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:15014:x1869977642720512:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783350072.683271:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350072.683300:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e36cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded302 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.683330:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e36cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded302 expref: 13 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.683341:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e36cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded302 expref: 13 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.683350:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8fa00, rc 0) 00000100:00100000:2.0:1783350072.683403:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:15014:x1869977642720512:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 150us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.683410:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 138 00000100:00100000:1.0:1783350072.691187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350072.691338:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642720640 00000100:00100000:3.0:1783350072.691348:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642720640 00000100:00100000:3.0:1783350072.691407:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 139 00000100:00100000:3.0:1783350072.691416:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:15014:x1869977642720640:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783350072.691605:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:15014:x1869977642720640:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 180us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.691613:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 139 00000100:00100000:1.0:1783350072.700927:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350072.701021:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642720768 00000100:00100000:0.0:1783350072.701031:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642720768 00000100:00100000:0.0:1783350072.701089:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 140 00000100:00100000:0.0:1783350072.701100:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:15014:x1869977642720768:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783350072.701291:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:15014:x1869977642720768:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 192us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350072.701300:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 140 00000100:00100000:3.0:1783350072.708363:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783350072.708710:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659571328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783350072.708777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350072.708856:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659571328 00000100:00100000:2.0:1783350072.708864:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659571328 00000100:00100000:2.0:1783350072.708913:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783350072.708921:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659571328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783350072.708944:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783350072.708986:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659571328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.708993:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783350072.709012:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783350072.709042:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659571328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783350072.709230:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659571584:0@lo:400:kworker.0 00000100:00100000:3.0:1783350072.709273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350072.709299:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659571200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783350072.709321:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350072.709338:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783350072.709344:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659571712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783350072.709365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350072.709400:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659571584 00000100:00100000:3.0:1783350072.709405:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659571584 00000100:00100000:3.0:1783350072.709432:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783350072.709439:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659571584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350072.711859:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659571584:12345-0@lo:400:kworker.0 Request processed in 2413us (2579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.711873:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783350072.711915:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659571200 00000100:00100000:3.0:1783350072.711922:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659571200 00000100:00100000:3.0:1783350072.711959:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659571712 00000100:00100000:3.0:1783350072.711962:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659571712 00000100:00100000:3.0:1783350072.711976:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783350072.711983:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659571200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783350072.712004:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783350072.712037:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659571200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.712055:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783350072.712068:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783350072.712074:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659571712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783350072.712084:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783350072.712109:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659571712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.712115:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1783350072.712130:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350072.712179:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659571456:0@lo:400:kworker.0 00000100:00100000:3.0:1783350072.712228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350072.712271:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783350072.712278:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659571840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783350072.712306:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350072.712329:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659571840 00000100:00100000:3.0:1783350072.712333:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659571840 00000100:00100000:3.0:1783350072.712359:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783350072.712365:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659571840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783350072.712375:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783350072.712405:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659571840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.712411:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1783350072.712424:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783350072.712444:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1783350072.712633:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659571712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783350072.712645:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659571584:0@lo:400:kworker.0 00000100:00100000:1.0:1783350072.712657:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659571200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783350072.713337:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659571840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783350072.713365:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659571456 00000100:00100000:3.0:1783350072.713383:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659571456 00000100:00100000:3.0:1783350072.713416:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783350072.713423:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659571456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350072.713611:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659571456:12345-0@lo:400:kworker.0 Request processed in 187us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.713617:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783350072.713737:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659571456:0@lo:400:kworker.0 00000100:00100000:1.0:1783350072.714625:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350072.714976:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642720896 00000100:00100000:3.0:1783350072.714983:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642720896 00000100:00100000:3.0:1783350072.715026:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:3.0:1783350072.715035:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:15021:x1869977642720896:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783350072.715185:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:15021:x1869977642720896:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 150us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.715192:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:2.0:1783350072.720526:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783350072.720556:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659571968:0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.720649:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350072.720875:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659572096:0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.720905:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350072.720974:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659572096 00000100:00100000:2.0:1783350072.720982:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659572096 00000100:00100000:2.0:1783350072.721030:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783350072.721040:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659572096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.721454:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659572096:12345-0@lo:400:kworker.0 Request processed in 413us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.721463:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783350072.721506:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659572096:0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.721541:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783350072.721548:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659572224:0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.721572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350072.721602:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659571968 00000100:00100000:2.0:1783350072.721606:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659571968 00000100:00100000:2.0:1783350072.721631:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659572224 00000100:00100000:2.0:1783350072.721633:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659572224 00000100:00100000:2.0:1783350072.721650:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783350072.721656:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659571968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.721687:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869977659571968:12345-0@lo:400:kworker.0 Request processed in 31us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.721693:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783350072.722301:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783350072.722314:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659572224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.722375:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869977659572224:12345-0@lo:400:kworker.0 Request processed in 65us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.722387:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783350072.722427:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869977659571968:0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.722471:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659572352:0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.722496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350072.722521:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659572352 00000100:00100000:2.0:1783350072.722525:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659572352 00000100:00100000:2.0:1783350072.722555:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783350072.722561:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659572352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.722588:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869977659572352:12345-0@lo:400:kworker.0 Request processed in 28us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.722594:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1783350072.722609:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783350072.722626:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869977659572352:0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.722652:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783350072.722657:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659572480:0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.722678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350072.722697:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659572480 00000100:00100000:2.0:1783350072.722700:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659572480 00000100:00100000:2.0:1783350072.722907:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783350072.723163:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659572480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.723208:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869977659572480:12345-0@lo:400:kworker.0 Request processed in 294us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.723214:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1783350072.723256:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea370d67480 x1869977659572480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350072.723282:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869977659572480:0@lo:400:kworker.0 00000100:00080000:3.0:1783350072.723316:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783350072.723373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350072.723423:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659572736:0@lo:400:kworker.0 00000100:00100000:3.0:1783350072.723437:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea370d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659572608:0@lo:400:kworker.0 00000100:00100000:1.0:1783350072.723462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350072.723540:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659572736 00000100:00100000:2.0:1783350072.723545:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659572736 00000100:00100000:2.0:1783350072.723617:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783350072.723624:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659572736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.723660:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659572736:12345-0@lo:400:kworker.0 Request processed in 36us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.723665:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783350072.723685:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642721024 00000100:00100000:2.0:1783350072.723689:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642721024 00000100:00100000:3.0:1783350072.723695:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350072.723728:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea241da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869977659572224:0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.723734:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 143 00000100:00100000:2.0:1783350072.723743:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:15021:x1869977642721024:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783350072.723766:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659572608 00000100:00100000:3.0:1783350072.723771:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659572608 00000100:00100000:2.0:1783350072.723866:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:15021:x1869977642721024:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 124us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.723874:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 143 00010000:00080000:2.0:1783350072.724575:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea243bae680 x1869977659572736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350072.724587:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659572736:0@lo:400:kworker.0 00000100:00080000:1.0:1783350072.725312:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783350072.725319:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783350072.740389:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350072.740481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350072.740512:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642721152 00000100:00100000:0.0:1783350072.740521:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642721152 00000100:00100000:0.0:1783350072.740554:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642721408 00000100:00100000:0.0:1783350072.740557:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642721408 00000100:00100000:0.0:1783350072.740572:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:0.0:1783350072.740579:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1869977642721152:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783350072.740621:0:17088:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 07a332e1-ec8f-4f86-8530-dd43a8d09e28@192.168.203.50@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:0.0:1783350072.740669:0:17088:0:(genops.c:1406:class_connect()) connect: client 07a332e1-ec8f-4f86-8530-dd43a8d09e28, cookie 0xd05e6ae1590e36d4 00000004:00100000:0.0:1783350072.740692:0:17088:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783350072.740775:0:17088:0:(import.c:65:import_set_state_nolock()) ffff8ea374650000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350072.740831:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2398:x1869977642721152:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 251us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350072.740839:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:0.0:1783350072.740856:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:0.0:1783350072.740860:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1869977642721408:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783350072.740876:0:17088:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 07a332e1-ec8f-4f86-8530-dd43a8d09e28@192.168.203.50@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:0.0:1783350072.740894:0:17088:0:(genops.c:1406:class_connect()) connect: client 07a332e1-ec8f-4f86-8530-dd43a8d09e28, cookie 0xd05e6ae1590e36db 00000004:00100000:0.0:1783350072.740905:0:17088:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783350072.740948:0:17088:0:(import.c:65:import_set_state_nolock()) ffff8ea374651000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783350072.740971:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2398:x1869977642721408:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 109us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350072.740978:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:2.0:1783350072.743506:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783350072.743526:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659572608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.743645:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869977659572608:12345-0@lo:400:kworker.0 Request processed in 128us (19953us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.743653:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783350072.743832:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea370d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869977659572608:0@lo:400:kworker.0 00000100:00100000:2.0:1783350072.745727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.745770:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.745803:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.745835:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642721664 00000100:00100000:2.0:1783350072.745844:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642721664 00000100:00100000:2.0:1783350072.745890:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642721536 00000100:00100000:2.0:1783350072.745893:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642721536 00000100:00100000:2.0:1783350072.745906:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642721280 00000100:00100000:2.0:1783350072.745909:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642721280 00000100:00100000:2.0:1783350072.745923:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:2.0:1783350072.745933:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+7:15014:x1869977642721664:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783350072.745969:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783350072.746043:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+7:15014:x1869977642721664:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.746051:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:2.0:1783350072.746066:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:2.0:1783350072.746072:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:0:x1869977642721536:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783350072.746086:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350072.746112:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:0:x1869977642721536:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 40us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.746119:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:2.0:1783350072.746129:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:2.0:1783350072.746162:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:0:x1869977642721280:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783350072.746172:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783350072.746191:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:0:x1869977642721280:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 56us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.746210:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00080000:1.0:1783350072.746369:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783350072.746373:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783350072.752070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350072.752171:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642721792 00000100:00100000:3.0:1783350072.752181:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642721792 00000100:00100000:3.0:1783350072.752249:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:3.0:1783350072.752258:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:15014:x1869977642721792:12345-192.168.203.50@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783350072.752354:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:15014:x1869977642721792:12345-192.168.203.50@tcp:40:mount.lustre.0 Request processed in 97us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.752362:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:0.0:1783350072.761407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350072.761442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350072.761478:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350072.761598:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642722176 00000100:00100000:3.0:1783350072.761609:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642722176 00000100:00100000:3.0:1783350072.761664:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1783350072.761673:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea379138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:15014:x1869977642722176:12345-192.168.203.50@tcp:900:mount.lustre.0 00000100:00100000:3.0:1783350072.761746:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea379138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:15014:x1869977642722176:12345-192.168.203.50@tcp:900:mount.lustre.0 Request processed in 73us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350072.761753:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:1.0:1783350072.762168:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642721920 00000100:00100000:1.0:1783350072.762174:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642721920 00000100:00100000:1.0:1783350072.762193:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642722048 00000100:00100000:1.0:1783350072.762195:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642722048 00000100:00100000:1.0:1783350072.762209:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:1.0:1783350072.762225:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1869977642721920:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783350072.762258:0:18596:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 07a332e1-ec8f-4f86-8530-dd43a8d09e28@192.168.203.50@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1783350072.762286:0:18596:0:(genops.c:1406:class_connect()) connect: client 07a332e1-ec8f-4f86-8530-dd43a8d09e28, cookie 0xd05e6ae1590e36e2 00002000:00100000:1.0:1783350072.762310:0:18596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 07a332e1-ec8f-4f86-8530-dd43a8d09e28/ffff8ea2437de000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783350072.762321:0:18596:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783350072.762378:0:18596:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783350072.762403:0:18596:0:(import.c:65:import_set_state_nolock()) ffff8ea2437dd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783350072.762439:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2398:x1869977642721920:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 223us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350072.762445:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:1.0:1783350072.762471:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:1.0:1783350072.762475:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1869977642722048:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783350072.762490:0:18596:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 07a332e1-ec8f-4f86-8530-dd43a8d09e28@192.168.203.50@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1783350072.762505:0:18596:0:(genops.c:1406:class_connect()) connect: client 07a332e1-ec8f-4f86-8530-dd43a8d09e28, cookie 0xd05e6ae1590e36e9 00002000:00100000:1.0:1783350072.762509:0:18596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 07a332e1-ec8f-4f86-8530-dd43a8d09e28/ffff8ea2437de800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783350072.762515:0:18596:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783350072.762557:0:18596:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783350072.762569:0:18596:0:(import.c:65:import_set_state_nolock()) ffff8ea2437df000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783350072.762589:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2398:x1869977642722048:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 113us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350072.762596:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1783350072.767762:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.767895:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642722304 00000100:00100000:2.0:1783350072.767907:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642722304 00000100:00100000:2.0:1783350072.767964:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:2.0:1783350072.767973:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:15014:x1869977642722304:12345-192.168.203.50@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783350072.768066:0:17091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783350072.768183:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:15014:x1869977642722304:12345-192.168.203.50@tcp:33:mount.lustre.0 Request processed in 210us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.768191:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:1.0:1783350072.947292:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350072.947358:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642722432 00000100:00100000:2.0:1783350072.947368:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642722432 00000100:00100000:2.0:1783350072.947442:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:2.0:1783350072.947456:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:15044:x1869977642722432:12345-192.168.203.50@tcp:101:mkdir.0 00010000:00010000:2.0:1783350072.947476:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350072.947494:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f200/0xd05e6ae1590e36f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded333 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.947561:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.947575:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.947588:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350072.947630:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783350072.947643:0:17087:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350072.947665:0:17087:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.947692:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f200/0xd05e6ae1590e36f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded333 expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.947708:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded333 expref: 7 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350072.947715:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c4400) 00010000:00010000:2.0:1783350072.947718:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783350072.947721:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e600, rc 0) 00000100:00100000:2.0:1783350072.947776:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+7:15044:x1869977642722432:12345-192.168.203.50@tcp:101:mkdir.0 Request processed in 326us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350072.947783:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00010000:00010000:3.0:1783350073.028481:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350073.220346:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783350073.220370:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659572864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783350073.220462:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350073.220556:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659572864 00000100:00100000:0.0:1783350073.220564:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659572864 00000100:00100000:0.0:1783350073.220630:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783350073.220639:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659572864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783350073.220692:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783350073.220747:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659572864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350073.220755:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783350073.220817:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659572864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350073.220960:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659572992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350073.220992:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350073.221298:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659572992 00000100:00100000:0.0:1783350073.221303:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659572992 00000100:00100000:0.0:1783350073.221334:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783350073.221341:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659572992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783350073.221360:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783350073.221403:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659572992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350073.221410:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783350073.221477:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659572992:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783350074.052884:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783350074.180948:0:17847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783350075.076314:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783350075.270915:0:19408:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000001:00100000:0.0:1783350075.270926:0:19408:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8a2801b7-a361-434c-b0c3-f6ccaa904300 00000001:00100000:3.0:1783350075.272898:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000001:00100000:3.0:1783350075.272909:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8a2801b7-a361-434c-b0c3-f6ccaa904300 00000001:00100000:2.0:1783350075.273729:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000001:00100000:2.0:1783350075.273737:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8a2801b7-a361-434c-b0c3-f6ccaa904300 00000001:00100000:1.0:1783350075.273969:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07a332e1-ec8f-4f86-8530-dd43a8d09e28 00000001:00100000:1.0:1783350075.273986:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a2801b7-a361-434c-b0c3-f6ccaa904300 00010000:00010000:0.0:1783350076.104253:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783350076.169332:0:19981:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1783350077.127870:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350077.828385:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659573120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783350077.828458:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350077.828545:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659573120 00000100:00100000:3.0:1783350077.828552:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659573120 00000100:00100000:3.0:1783350077.828600:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783350077.828610:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659573120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783350077.828641:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783350077.828689:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659573120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350077.828695:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783350077.828748:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659573120:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783350077.828841:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350077.828884:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783350077.828892:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659573248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783350077.828917:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.828988:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659573248 00000100:00100000:1.0:1783350077.828993:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659573248 00000100:00100000:1.0:1783350077.829030:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783350077.829037:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659573248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783350077.829053:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783350077.829088:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659573248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.829094:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783350077.829127:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659573248:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783350077.829207:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783350077.829322:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659573376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783350077.829351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.829646:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659573504:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.829677:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.829700:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659574016:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.829722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.829738:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659574528:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.829761:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.829781:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783350077.829787:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659573888:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.829811:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.829830:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659574400:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.829849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.829872:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659573504 00000100:00100000:1.0:1783350077.829875:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659573504 00000100:00100000:1.0:1783350077.829901:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783350077.829907:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659573504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.829954:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659573504:12345-0@lo:400:kworker.0 Request processed in 46us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.829960:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783350077.829989:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659574016 00000100:00100000:1.0:1783350077.829993:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659574016 00000100:00100000:1.0:1783350077.830022:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783350077.830028:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659574016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830057:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659574016:12345-0@lo:400:kworker.0 Request processed in 29us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.830063:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783350077.830081:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659574528 00000100:00100000:1.0:1783350077.830084:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659574528 00000100:00100000:1.0:1783350077.830103:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659574400 00000100:00100000:1.0:1783350077.830105:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659574400 00000100:00100000:1.0:1783350077.830122:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783350077.830128:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659574528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830183:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659574528:12345-0@lo:400:kworker.0 Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.830189:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783350077.830208:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783350077.830214:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659574400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830238:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869977659574400:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.830243:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783350077.830268:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659573760:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830290:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.830315:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659574272:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830337:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.830352:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783350077.830357:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659573632:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830378:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.830393:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659574144:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830411:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.830422:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659574656:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830441:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350077.830478:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659573888 00000100:00100000:1.0:1783350077.830482:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659573888 00000100:00100000:1.0:1783350077.830510:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659573632 00000100:00100000:1.0:1783350077.830513:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659573632 00000100:00100000:1.0:1783350077.830527:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783350077.830533:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659573888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830562:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659573888:12345-0@lo:400:kworker.0 Request processed in 29us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.830569:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783350077.830582:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783350077.830587:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659573632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830617:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659573632:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.830623:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783350077.830638:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659573760 00000100:00100000:1.0:1783350077.830641:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659573760 00000100:00100000:1.0:1783350077.830654:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659574272 00000100:00100000:1.0:1783350077.830657:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659574272 00000100:00100000:1.0:1783350077.830675:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659574144 00000100:00100000:1.0:1783350077.830677:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659574144 00000100:00100000:1.0:1783350077.830686:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659574656 00000100:00100000:1.0:1783350077.830688:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659574656 00000100:00100000:1.0:1783350077.830701:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783350077.830706:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659573760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830737:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659573760:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.830742:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783350077.830753:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783350077.830758:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659574272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830784:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869977659574272:12345-0@lo:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.830790:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783350077.830800:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783350077.830806:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659574144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830831:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869977659574144:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.830836:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783350077.830845:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783350077.830851:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659574656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830875:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869977659574656:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.830881:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1783350077.830896:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783350077.830899:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783350077.830901:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783350077.830939:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659573632:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830949:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869977659574144:0@lo:400:kworker.0 00010000:00080000:1.0:1783350077.830960:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cce9500 x1869977659574656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350077.830970:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869977659574656:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830979:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659573760:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.830988:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869977659574272:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.831022:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659573888:0@lo:400:kworker.0 00010000:00080000:1.0:1783350077.831033:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea36cce8e00 x1869977659574400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783350077.831042:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869977659574400:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.831050:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659573504:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.831059:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659574016:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.831069:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659574528:0@lo:400:kworker.0 00000100:00100000:1.0:1783350077.831095:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659573376 00000100:00100000:1.0:1783350077.831099:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659573376 00000100:00100000:1.0:1783350077.831128:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783350077.831159:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659573376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783350077.831174:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783350077.831218:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659573376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350077.831232:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1783350077.831250:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783350077.831272:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659573376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783350077.831389:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783350077.831399:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659574784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783350077.831428:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350077.831460:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659574784 00000100:00100000:3.0:1783350077.831464:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659574784 00000100:00100000:3.0:1783350077.831486:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783350077.831492:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659574784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783350077.831503:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783350077.831533:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659574784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350077.831539:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783350077.831568:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659574784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783350078.046228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350078.046271:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350078.046289:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350078.046310:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350078.046336:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350078.046356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350078.046377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350078.046405:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350078.046437:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350078.046467:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642722688 00000100:00100000:0.0:1783350078.046475:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642722688 00000100:00100000:0.0:1783350078.046532:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642723200 00000100:00100000:0.0:1783350078.046535:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642723200 00000100:00100000:0.0:1783350078.046547:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642722816 00000100:00100000:0.0:1783350078.046549:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642722816 00000100:00100000:0.0:1783350078.046559:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642723328 00000100:00100000:0.0:1783350078.046561:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642723328 00000100:00100000:0.0:1783350078.046577:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:0.0:1783350078.046586:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2400:x1869977642722688:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350078.046654:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2400:x1869977642722688:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 69us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350078.046662:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:0.0:1783350078.046679:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:0.0:1783350078.046685:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2400:x1869977642723200:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350078.046709:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2400:x1869977642723200:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350078.046716:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:0.0:1783350078.046726:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:0.0:1783350078.046731:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2400:x1869977642722816:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350078.046766:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2400:x1869977642722816:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 35us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350078.046774:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:0.0:1783350078.046785:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:0.0:1783350078.046791:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2400:x1869977642723328:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350078.046814:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2400:x1869977642723328:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350078.046829:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:0.0:1783350078.046846:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642722944 00000100:00100000:0.0:1783350078.046850:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642722944 00000100:00100000:0.0:1783350078.046870:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642723456 00000100:00100000:0.0:1783350078.046872:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642723456 00000100:00100000:0.0:1783350078.046882:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642723072 00000100:00100000:0.0:1783350078.046885:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642723072 00000100:00100000:0.0:1783350078.046895:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642723584 00000100:00100000:0.0:1783350078.046897:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642723584 00000100:00100000:0.0:1783350078.046909:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1783350078.046914:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2400:x1869977642722944:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350078.046942:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2400:x1869977642722944:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 27us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350078.046948:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1783350078.046959:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:0.0:1783350078.046964:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2400:x1869977642723456:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350078.046985:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2400:x1869977642723456:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 21us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350078.046991:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:0.0:1783350078.047002:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:0.0:1783350078.047007:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2400:x1869977642723072:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350078.047027:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2400:x1869977642723072:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 20us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350078.047033:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:0.0:1783350078.047043:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1783350078.047057:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2400:x1869977642723584:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350078.047082:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2400:x1869977642723584:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350078.047087:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1783350078.047105:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642722560 00000100:00100000:0.0:1783350078.047108:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642722560 00000100:00100000:0.0:1783350078.047132:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 145 00000100:00100000:0.0:1783350078.047160:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2400:x1869977642722560:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350078.047180:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2400:x1869977642722560:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350078.047185:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 145 00000100:00080000:0.0:1783350078.047235:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783350078.047239:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783350078.047242:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783350078.047244:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783350078.153845:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350078.343547:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659574912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783350078.343616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350078.343668:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659574912 00000100:00100000:1.0:1783350078.343687:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659574912 00000100:00100000:1.0:1783350078.343730:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783350078.343738:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659574912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783350078.343789:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783350078.343834:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659574912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350078.343841:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783350078.343880:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36ccea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659574912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783350078.344582:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783350078.344595:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659575040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783350078.344631:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350078.344663:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659575040 00000100:00100000:3.0:1783350078.344667:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659575040 00000100:00100000:3.0:1783350078.344702:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783350078.344709:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659575040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783350078.344730:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783350078.344768:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659575040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350078.344784:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783350078.344818:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659575040:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1783350079.109107:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783350079.172584:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783350080.101835:0:20128:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff455c3e90 20000000:00000080:0.0:1783350080.101852:0:20128:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ea36d767c00 uarg=0000000000000000 20000000:01000000:0.0:1783350080.101893:0:20128:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783350080.101899:0:20128:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783350080.101905:0:20128:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1783350080.104517:0:20129:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1783350080.104679:0:20128:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783350080.112221:0:20128:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783350080.112252:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112273:0:20128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3393 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e338c expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112296:0:20128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e33a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e339a expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112304:0:20128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e33e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e33d9 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112311:0:20128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e347a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3473 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112321:0:20128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e368e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded292 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112328:0:20128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e36cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded302 expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112336:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112377:0:20128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e36cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded302 expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112391:0:20128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e36cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded302 expref: 12 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350080.112408:0:20128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659575168:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783350080.112507:0:20128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e368e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded292 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112515:0:20128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e368e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded292 expref: 12 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350080.112532:0:20128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244778e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659575296:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783350080.112568:0:20128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e347a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e3473 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112576:0:20128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e347a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e3473 expref: 23 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350080.112585:0:20128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24477aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659575424:0@lo:104: 00000100:00100000:0.0:1783350080.112623:0:20128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783350080.112668:0:20128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e33e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e33d9 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112677:0:20128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e33e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e33d9 expref: 23 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350080.112685:0:20128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244779c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659575552:0@lo:104: 00000100:00100000:0.0:1783350080.112708:0:20128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350080.112746:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659575424 00000100:00100000:0.0:1783350080.112753:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659575424 00000100:00100000:0.0:1783350080.112788:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659575552 00000100:00100000:0.0:1783350080.112791:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659575552 00000100:00100000:0.0:1783350080.112806:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783350080.112814:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+4:20128:x1869977659575424:12345-0@lo:104: 00010000:00010000:0.0:1783350080.112826:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112867:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783350080.112872:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+4:20128:x1869977659575424:12345-0@lo:104: Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350080.112884:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783350080.112903:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783350080.112909:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:20128:x1869977659575552:12345-0@lo:104: 00010000:00010000:0.0:1783350080.112916:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112945:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783350080.112950:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:20128:x1869977659575552:12345-0@lo:104: Request processed in 41us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350080.112956:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1783350080.112985:0:20128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e33a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e339a expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.112993:0:20128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e33a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e339a expref: 23 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350080.113002:0:20128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659575680:0@lo:104: 00000100:00100000:0.0:1783350080.113024:0:20128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350080.113043:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659575680 00000100:00100000:0.0:1783350080.113046:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659575680 00000100:00100000:0.0:1783350080.113062:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783350080.113067:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:20128:x1869977659575680:12345-0@lo:104: 00010000:00010000:0.0:1783350080.113074:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113103:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783350080.113109:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:20128:x1869977659575680:12345-0@lo:104: Request processed in 42us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350080.113124:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1783350080.113170:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783350080.113189:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113198:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8ca00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350080.113202:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113210:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350080.113216:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350080.113222:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783350080.113248:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113254:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350080.113271:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113277:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8ca00/0xd05e6ae1590e3473 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e347a expref: -99 pid: 19407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113290:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783350080.113293:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113309:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3417c7e00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350080.113312:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113318:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350080.113324:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350080.113329:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783350080.113344:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113350:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350080.113357:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113363:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea3417c7e00/0xd05e6ae1590e33d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e33e0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113373:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350080.113376:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113381:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c200 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350080.113384:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113402:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350080.113408:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350080.113412:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783350080.113426:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113432:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350080.113444:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113450:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8c200/0xd05e6ae1590e339a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e33a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113459:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350080.113460:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350080.113462:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350080.113487:0:20128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd05e6ae1590e338c expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113494:0:20128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3393 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd05e6ae1590e338c expref: 23 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350080.113503:0:20128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659576192:0@lo:104: 00000100:00100000:0.0:1783350080.113528:0:20128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350080.113548:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659576192 00000100:00100000:0.0:1783350080.113558:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659576192 00000100:00100000:0.0:1783350080.113575:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783350080.113581:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:20128:x1869977659576192:12345-0@lo:104: 00010000:00010000:0.0:1783350080.113588:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113620:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783350080.113625:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+3:20128:x1869977659576192:12345-0@lo:104: Request processed in 45us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350080.113632:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1783350080.113645:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783350080.113649:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113655:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364bc00 already unused, calling callback (ffffffffc1361c20) 10000000:00010000:0.0:1783350080.113658:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113664:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783350080.113671:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783350080.113677:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783350080.113694:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113699:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783350080.113706:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113718:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8ea24364bc00/0xd05e6ae1590e338c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd05e6ae1590e3393 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350080.113730:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350080.113732:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783350080.113734:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350080.113749:0:20128:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508ce240 going to sleep for 11 seconds 00000100:00100000:0.0:1783350080.113771:0:20128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659575424:0@lo:104: 00000100:00100000:0.0:1783350080.113780:0:20128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244779c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659575552:0@lo:104: 00000100:00100000:0.0:1783350080.113786:0:20128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244778000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659575680:0@lo:104: 00000100:00100000:0.0:1783350080.113792:0:20128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659576192:0@lo:104: 00010000:00010000:1.0:1783350080.114546:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350080.114560:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659575936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350080.114599:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350080.114632:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783350080.114638:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659575808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350080.114658:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350080.114694:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659576320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350080.114714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350080.114733:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783350080.114738:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659576064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350080.114767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350080.114788:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659575936 00000100:00100000:1.0:1783350080.114793:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659575936 00010000:00010000:1.0:1783350080.114816:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e33e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e33d9 expref: 24 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350080.114833:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659575808 00000100:00100000:1.0:1783350080.114836:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659575808 00010000:00010000:1.0:1783350080.114846:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e347a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3473 expref: 25 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350080.114855:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659576320 00000100:00100000:1.0:1783350080.114857:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659576320 00010000:00010000:1.0:1783350080.114866:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3393 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e338c expref: 26 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350080.114875:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659576064 00000100:00100000:1.0:1783350080.114877:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659576064 00010000:00010000:1.0:1783350080.114886:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e33a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e339a expref: 27 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350080.114899:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350080.114906:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+27:3649:x1869977659575936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350080.114919:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350080.114924:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e33e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e33d9 expref: 27 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.114932:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e33e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e33d9 expref: 27 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.114946:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8dc00/0xd05e6ae1590e33e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e33d9 expref: 27 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.114966:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350080.114995:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+26:3649:x1869977659575936:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350080.115002:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783350080.115015:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783350080.115021:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+25:3649:x1869977659575808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350080.115027:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350080.115031:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e347a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e3473 expref: 25 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.115038:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e347a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e3473 expref: 25 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.115047:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e347a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e3473 expref: 25 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.115055:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350080.115075:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3649:x1869977659575808:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350080.115080:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783350080.115091:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783350080.115096:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:3647:x1869977659576320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350080.115102:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350080.115106:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3393 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e338c expref: 23 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.115114:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e338c expref: 23 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.115131:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea3417c6c00/0xd05e6ae1590e3393 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e338c expref: 23 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.115163:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350080.115202:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:3647:x1869977659576320:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350080.115208:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783350080.115221:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783350080.115226:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:3647:x1869977659576064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783350080.115234:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350080.115238:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e33a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd05e6ae1590e339a expref: 21 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.115246:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e33a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd05e6ae1590e339a expref: 21 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.115255:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36dd8d200/0xd05e6ae1590e33a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd05e6ae1590e339a expref: 21 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.115263:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350080.115298:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:3647:x1869977659576064:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350080.115304:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783350080.115347:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659576064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350080.115355:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659576320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350080.115379:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659575808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783350080.115394:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3649:1869977659575936:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783350080.115637:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350080.121012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350080.121047:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350080.121083:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642723840 00000100:00100000:3.0:1783350080.121092:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642723840 00010000:00010000:3.0:1783350080.121127:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e368e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded292 expref: 13 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350080.121166:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642723712 00000100:00100000:3.0:1783350080.121169:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642723712 00010000:00010000:3.0:1783350080.121190:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e36cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded302 expref: 14 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350080.121205:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1783350080.121213:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243255450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02fc5821-de16-4655-b2ee-a46099f9f1d8+14:2399:x1869977642723840:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783350080.121227:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350080.121233:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e368e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded292 expref: 14 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121243:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e368e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded292 expref: 14 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121261:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783350080.121321:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243255450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02fc5821-de16-4655-b2ee-a46099f9f1d8+14:2399:x1869977642723840:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350080.121344:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1783350080.121388:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:3.0:1783350080.121396:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2399:x1869977642723712:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783350080.121404:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350080.121409:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e36cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded302 expref: 13 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121419:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e36cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded302 expref: 13 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121432:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121439:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121454:0:17072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121461:0:17072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121467:0:17072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121474:0:17072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121480:0:17072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b800 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350080.121491:0:17072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121500:0:17072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121509:0:17072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350080.121518:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783350080.121539:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2399:x1869977642723712:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 144us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350080.121546:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00010000:00010000:2.0:1783350080.121748:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea36da8fa00/0xd05e6ae1590e36cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded302 expref: 12 pid: 17079 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350080.121773:0:20128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24477bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659575168:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783350080.121787:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea24364a200/0xd05e6ae1590e368e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded292 expref: 11 pid: 17082 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350080.121796:0:20128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244778e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20128:1869977659575296:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783350080.121823:0:20128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350080.121832:0:20128:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350080.121838:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350080.121844:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e36fe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350080.197571:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783350081.222616:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783350081.671850:0:17084:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783350081.671858:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea34778c000 from 13 10000000:01000000:2.0:1783350081.671864:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783350081.671914:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350081.671926:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350081.671936:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350081.671979:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659576448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783350081.672060:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350081.672099:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19180 going to sleep for 11 seconds 00000100:00100000:0.0:1783350081.672188:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659576448 00000100:00100000:0.0:1783350081.672196:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659576448 00000100:00100000:0.0:1783350081.672246:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783350081.672255:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+20:17084:x1869977659576448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783350081.672269:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350081.672284:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea24364bc00/0xd05e6ae1590e370c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3705 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350081.672308:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea24364bc00/0xd05e6ae1590e370c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3705 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350081.672318:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea24364bc00/0xd05e6ae1590e370c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3705 expref: 21 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350081.672327:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364bc00, rc 0) 00000100:00100000:0.0:1783350081.672367:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:17084:x1869977659576448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350081.672381:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783350081.672477:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659576448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350081.672492:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350081.672501:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350081.672560:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659576576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350081.672585:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350081.672610:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19180 going to sleep for 11 seconds 00000100:00100000:0.0:1783350081.672781:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659576576 00000100:00100000:0.0:1783350081.672786:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659576576 00000100:00100000:0.0:1783350081.672816:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783350081.672822:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:17084:x1869977659576576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783350081.672919:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:17084:x1869977659576576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350081.672925:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783350081.673005:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659576576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350081.673037:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659576704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783350081.673073:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350081.673093:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19180 going to sleep for 11 seconds 00000100:00100000:0.0:1783350081.673204:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659576704 00000100:00100000:0.0:1783350081.673209:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659576704 00000100:00100000:0.0:1783350081.673231:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783350081.673237:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:17084:x1869977659576704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783350081.673311:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:17084:x1869977659576704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350081.673317:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783350081.673353:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659576704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783350081.685909:0:20181:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783350081.686006:0:17084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783350081.686028:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783350081.686040:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.686050:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8f200/0xd05e6ae1590e3705 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e370c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350081.686060:0:17084:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783350081.686062:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea347517800 from 13 10000000:01000000:1.0:1783350081.686065:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783350081.686098:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.686107:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.686116:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350081.686178:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659576832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.686244:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350081.686582:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350081.691969:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659576832 00000100:00100000:2.0:1783350081.691983:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659576832 00000100:00100000:2.0:1783350081.692047:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783350081.692057:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+21:17084:x1869977659576832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350081.692073:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350081.692089:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e371a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3713 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350081.692157:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e371a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3713 expref: 22 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350081.692178:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36da8f800/0xd05e6ae1590e371a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3713 expref: 22 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350081.692188:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f800, rc 0) 00000100:00100000:2.0:1783350081.692263:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:17084:x1869977659576832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (6019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350081.692271:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783350081.692330:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659576832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783350081.692348:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350081.692358:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350081.692431:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659576960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350081.692462:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350081.692483:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350081.692498:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659576960 00000100:00100000:2.0:1783350081.692501:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659576960 00000100:00100000:2.0:1783350081.692523:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783350081.692530:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:17084:x1869977659576960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350081.692639:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:17084:x1869977659576960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350081.692655:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783350081.692682:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659576960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783350081.692707:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783350081.692739:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350081.692751:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783350081.692762:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659577088 00000100:00100000:2.0:1783350081.692765:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659577088 00000100:00100000:2.0:1783350081.692785:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783350081.692791:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:17084:x1869977659577088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783350081.692872:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:17084:x1869977659577088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350081.692878:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783350081.692915:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783350081.693967:0:20185:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783350081.694328:0:17084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783350081.694346:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783350081.694357:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350081.694367:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8dc00/0xd05e6ae1590e3713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e371a expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783350081.694378:0:17084:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783350081.694380:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea348c55800 from 13 10000000:01000000:2.0:1783350081.694383:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783350081.694409:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350081.694430:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350081.694440:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350081.694460:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783350081.694507:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350081.694540:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea36cd19b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350081.697293:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659577216 00000100:00100000:1.0:1783350081.697313:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659577216 00000100:00100000:1.0:1783350081.697363:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783350081.697372:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+22:17084:x1869977659577216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350081.697388:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350081.697404:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8da00/0xd05e6ae1590e3728 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e3721 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.697429:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8da00/0xd05e6ae1590e3728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e3721 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.697438:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8da00/0xd05e6ae1590e3728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e3721 expref: 23 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.697447:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8da00, rc 0) 00000100:00100000:1.0:1783350081.697518:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:17084:x1869977659577216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (3010us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350081.697525:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783350081.697583:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350081.697601:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.697610:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350081.697679:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.697711:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350081.697737:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350081.697750:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659577344 00000100:00100000:1.0:1783350081.697760:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659577344 00000100:00100000:1.0:1783350081.697783:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783350081.697790:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:17084:x1869977659577344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.697894:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:17084:x1869977659577344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350081.697901:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783350081.697928:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.697952:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.697989:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350081.698001:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350081.698011:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659577472 00000100:00100000:1.0:1783350081.698015:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659577472 00000100:00100000:1.0:1783350081.698035:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783350081.698041:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:17084:x1869977659577472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.698115:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:17084:x1869977659577472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350081.698233:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783350081.698276:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783350081.699025:0:20186:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783350081.703295:0:17084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783350081.703331:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783350081.703344:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.703356:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36da8fa00/0xd05e6ae1590e3721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3728 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783350081.703380:0:17084:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783350081.703383:0:17084:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ea37f5b5800 from 13 10000000:01000000:1.0:1783350081.703386:0:17084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783350081.703419:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.703428:0:17084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.703439:0:17084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350081.703462:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.703526:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350081.703563:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242741a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783350081.703586:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659577600 00000100:00100000:1.0:1783350081.703592:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659577600 00000100:00100000:1.0:1783350081.703634:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783350081.703642:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+23:17084:x1869977659577600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350081.703655:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350081.703668:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e3736 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd05e6ae1590e372f expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.703690:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e3736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd05e6ae1590e372f expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.703701:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea36dd8c400/0xd05e6ae1590e3736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd05e6ae1590e372f expref: 24 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.703720:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c400, rc 0) 00000100:00100000:1.0:1783350081.703756:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:17084:x1869977659577600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350081.703763:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783350081.703809:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783350081.703821:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.703830:0:17084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350081.703880:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.703905:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350081.703918:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242741a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783350081.703930:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659577728 00000100:00100000:1.0:1783350081.703933:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659577728 00000100:00100000:1.0:1783350081.703955:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783350081.703961:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:17084:x1869977659577728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.704062:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:17084:x1869977659577728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350081.704068:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783350081.704098:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.709278:0:17084:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.709365:0:17084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350081.709413:0:17084:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea242741a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783350081.709450:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659577856 00000100:00100000:1.0:1783350081.709457:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659577856 00000100:00100000:1.0:1783350081.709500:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783350081.709508:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:17084:x1869977659577856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783350081.709616:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:17084:x1869977659577856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350081.709625:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783350081.709680:0:17084:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:17084:1869977659577856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783350081.710561:0:20187:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783350081.710624:0:17084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783350081.710641:0:17084:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783350081.710651:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350081.710661:0:17084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8ea36dd8de00/0xd05e6ae1590e372f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd05e6ae1590e3736 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350082.011612:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350082.011851:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642723968 00000100:00100000:3.0:1783350082.011861:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642723968 00000100:00100000:3.0:1783350082.011912:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 158 00000100:00100000:3.0:1783350082.011921:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+11:14895:x1869977642723968:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783350082.011939:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350082.011955:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e373d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded33a expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350082.011982:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e373d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded33a expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350082.011992:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea3582cd800/0xd05e6ae1590e373d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded33a expref: 12 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350082.012001:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd800, rc 0) 00000100:00100000:3.0:1783350082.012051:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:14895:x1869977642723968:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 132us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350082.012064:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 158 00000100:00100000:3.0:1783350082.024524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350082.024642:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642724096 00000100:00100000:0.0:1783350082.024652:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642724096 00000100:00100000:0.0:1783350082.024708:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 159 00000100:00100000:0.0:1783350082.024717:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:14895:x1869977642724096:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783350082.024849:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:14895:x1869977642724096:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 132us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.024857:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 159 00000100:00100000:0.0:1783350082.034605:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350082.034699:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642724224 00000100:00100000:2.0:1783350082.034709:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642724224 00000100:00100000:2.0:1783350082.034791:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 160 00000100:00100000:2.0:1783350082.034802:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:14895:x1869977642724224:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783350082.034937:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:14895:x1869977642724224:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 136us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350082.034945:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 160 00000100:00100000:2.0:1783350082.050611:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350082.051449:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642724352 00000100:00100000:0.0:1783350082.051460:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642724352 00000100:00100000:0.0:1783350082.051512:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 161 00000100:00100000:0.0:1783350082.051522:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+12:14895:x1869977642724352:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783350082.051539:0:17079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350082.051557:0:17079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e3744 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded341 expref: -99 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350082.051583:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e3744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded341 expref: 13 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350082.051594:0:17079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ea24364b800/0xd05e6ae1590e3744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded341 expref: 13 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350082.051602:0:17079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b800, rc 0) 00000100:00100000:0.0:1783350082.051657:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:14895:x1869977642724352:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 137us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.051664:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 161 00000100:00100000:3.0:1783350082.058116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350082.059069:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642724480 00000100:00100000:1.0:1783350082.059081:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642724480 00000100:00100000:1.0:1783350082.059159:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 162 00000100:00100000:1.0:1783350082.059178:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:14895:x1869977642724480:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783350082.059332:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:14895:x1869977642724480:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 156us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350082.059341:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 162 00000100:00100000:1.0:1783350082.061824:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350082.061898:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642724608 00000100:00100000:3.0:1783350082.061907:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642724608 00000100:00100000:3.0:1783350082.061960:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 163 00000100:00100000:3.0:1783350082.061970:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:14895:x1869977642724608:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783350082.062098:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:14895:x1869977642724608:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 129us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350082.062105:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 163 00010000:00010000:3.0:1783350082.244398:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350082.953455:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659578112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783350082.953523:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350082.953557:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659577984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783350082.953580:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350082.955129:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659578240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783350082.955208:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350082.962078:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659578368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783350082.962189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350082.964755:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659578112 00000100:00100000:0.0:1783350082.964766:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659578112 00000100:00100000:1.0:1783350082.964771:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659578496:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.964811:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659577984 00000100:00100000:0.0:1783350082.964815:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659577984 00000100:00100000:0.0:1783350082.964827:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659578240 00000100:00100000:0.0:1783350082.964830:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659578240 00000100:00100000:0.0:1783350082.964840:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659578368 00000100:00100000:0.0:1783350082.964843:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659578368 00000100:00100000:0.0:1783350082.964861:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783350082.964869:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659578112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783350082.964916:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783350082.964992:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659578112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (11469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.964999:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783350082.965017:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783350082.965023:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659577984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783350082.965038:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783350082.965068:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659577984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (11487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.965074:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783350082.965087:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783350082.965092:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659578240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783350082.965103:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783350082.965168:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869977659578240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (9927us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.965175:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783350082.965186:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783350082.965192:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659578368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783350082.965201:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783350082.965227:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659578368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.965233:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1783350082.965518:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783350082.965522:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783350082.965562:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659578112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783350082.965590:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659577984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783350082.965616:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350082.965635:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea243081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869977659578240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783350082.965671:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659578368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783350082.965691:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659578496 00000100:00100000:1.0:1783350082.965695:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659578496 00000100:00100000:1.0:1783350082.965721:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783350082.965722:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659578624:0@lo:400:kworker.0 00000100:00100000:1.0:1783350082.965727:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659578496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.965750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350082.965756:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659578496:12345-0@lo:400:kworker.0 Request processed in 30us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350082.965763:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783350082.965788:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659578624 00000100:00100000:0.0:1783350082.965792:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659578624 00000100:00100000:0.0:1783350082.965818:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783350082.965823:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659578624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.965860:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659578624:12345-0@lo:400:kworker.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.965866:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783350082.965894:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659578624:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.965923:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659578752:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.965948:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350082.965979:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659578752 00000100:00100000:0.0:1783350082.965982:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659578752 00000100:00100000:0.0:1783350082.966007:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783350082.966013:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659578752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.966047:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869977659578752:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.966053:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783350082.966079:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869977659578752:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.968561:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659579136:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.968642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350082.968709:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659579136 00000100:00100000:0.0:1783350082.968715:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659579136 00000100:00100000:0.0:1783350082.968764:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783350082.968773:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659579136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.968835:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659579136:12345-0@lo:400:kworker.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.968843:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1783350082.968866:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783350082.968899:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659579136:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.968934:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659579264:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.968958:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350082.968988:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659579264 00000100:00100000:0.0:1783350082.968991:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659579264 00000100:00100000:0.0:1783350082.970522:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783350082.970535:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659579264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.970602:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659579264:12345-0@lo:400:kworker.0 Request processed in 71us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.970610:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1783350082.970659:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2444ef100 x1869977659579264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350082.970672:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659579264:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.970755:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659578880:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.970788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350082.970808:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659579392:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.970844:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350082.970861:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783350082.970867:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659579008:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.970887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350082.970902:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2444ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659579520:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.970920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350082.970941:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659579392 00000100:00100000:0.0:1783350082.970946:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659579392 00000100:00100000:0.0:1783350082.970966:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659579008 00000100:00100000:0.0:1783350082.970968:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659579008 00000100:00100000:0.0:1783350082.970977:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659579520 00000100:00100000:0.0:1783350082.970979:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659579520 00000100:00100000:0.0:1783350082.970991:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783350082.970996:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659579392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.971032:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869977659579392:12345-0@lo:400:kworker.0 Request processed in 34us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.971038:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783350082.971050:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783350082.971056:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659579008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.971082:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869977659579008:12345-0@lo:400:kworker.0 Request processed in 27us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.971088:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783350082.971099:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783350082.971104:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659579520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.971130:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869977659579520:12345-0@lo:400:kworker.0 Request processed in 26us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350082.971192:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783350082.971224:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869977659579008:0@lo:400:kworker.0 00010000:00080000:0.0:1783350082.971234:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea2444ece00 x1869977659579520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783350082.971243:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869977659579520:0@lo:400:kworker.0 00000100:00100000:0.0:1783350082.972100:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869977659579392:0@lo:400:kworker.0 00000100:00100000:3.0:1783350082.972338:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659578880 00000100:00100000:3.0:1783350082.972344:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659578880 00000100:00100000:3.0:1783350082.972387:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783350082.972395:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659578880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783350082.972455:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869977659578880:12345-0@lo:400:kworker.0 Request processed in 61us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350082.972462:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1783350082.972481:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783350082.972484:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783350082.972496:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659578496:0@lo:400:kworker.0 00000100:00100000:3.0:1783350082.972500:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2444efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869977659578880:0@lo:400:kworker.0 00000100:00100000:2.0:1783350083.160382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350083.160425:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350083.160462:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350083.160492:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350083.160510:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350083.160528:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350083.160543:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350083.160577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350083.160597:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350083.160627:0:19527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642725248 00000100:00100000:2.0:1783350083.160636:0:19527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642725248 00000100:00100000:2.0:1783350083.160684:0:19527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642725760 00000100:00100000:2.0:1783350083.160687:0:19527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642725760 00000100:00100000:2.0:1783350083.160701:0:19527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642725120 00000100:00100000:2.0:1783350083.160703:0:19527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642725120 00000100:00100000:2.0:1783350083.160714:0:19527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642725632 00000100:00100000:2.0:1783350083.160716:0:19527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642725632 00000100:00100000:2.0:1783350083.160730:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1783350083.160739:0:19527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642725248:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350083.160805:0:19527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642725248:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 66us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350083.160813:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1783350083.160829:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:2.0:1783350083.160836:0:19527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642725760:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783350083.160838:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:1.0:1783350083.160846:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642725120:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350083.160860:0:19527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642725760:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350083.160866:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:1.0:1783350083.160868:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642725120:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350083.160874:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:2.0:1783350083.160877:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:2.0:1783350083.160882:0:19527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642725632:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350083.160904:0:19527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642725632:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 21us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350083.160910:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00080000:3.0:1783350083.161171:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783350083.161176:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783350083.161187:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642724992 00000100:00100000:3.0:1783350083.161191:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642724992 00000100:00100000:3.0:1783350083.161227:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642725504 00000100:00100000:3.0:1783350083.161230:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642725504 00000100:00100000:3.0:1783350083.161242:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642724864 00000100:00100000:3.0:1783350083.161244:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642724864 00000100:00100000:3.0:1783350083.161255:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642725376 00000100:00100000:3.0:1783350083.161257:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642725376 00000100:00100000:3.0:1783350083.161270:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:3.0:1783350083.161277:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642724992:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350083.161289:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642724736 00000100:00100000:0.0:1783350083.161293:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642724736 00000100:00100000:0.0:1783350083.161320:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 165 00000100:00100000:3.0:1783350083.161321:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642724992:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 44us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350083.161327:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:0.0:1783350083.161335:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2402:x1869977642724736:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350083.161339:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:3.0:1783350083.161344:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642725504:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350083.161360:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2402:x1869977642724736:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350083.161362:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642725504:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 18us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350083.161367:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:0.0:1783350083.161367:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 165 00000100:00100000:3.0:1783350083.161377:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:3.0:1783350083.161382:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2402:x1869977642724864:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350083.161402:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2402:x1869977642724864:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 19us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350083.161402:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:3.0:1783350083.161408:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:0.0:1783350083.161409:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2402:x1869977642725376:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1783350083.161430:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2402:x1869977642725376:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350083.161436:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00080000:2.0:1783350083.161486:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783350083.161498:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783350083.270950:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783350083.460769:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea24465dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659579648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783350083.460841:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350083.460966:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659579648 00000100:00100000:3.0:1783350083.460987:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659579648 00000100:00100000:3.0:1783350083.461044:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783350083.461053:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659579648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783350083.461090:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783350083.461225:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659579648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 174us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350083.461233:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783350083.462323:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea24465dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659579648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783350083.462682:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783350083.462695:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659579776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783350083.462741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783350083.462864:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659579776 00000100:00100000:0.0:1783350083.462870:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659579776 00000100:00100000:0.0:1783350083.462916:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783350083.462936:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659579776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783350083.462963:0:17828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783350083.463013:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659579776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350083.463019:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783350083.463108:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659579776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350084.223281:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350084.223431:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642725888 00000100:00100000:3.0:1783350084.223454:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642725888 00000100:00100000:3.0:1783350084.223547:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:3.0:1783350084.223558:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:15560:x1869977642725888:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783350084.223589:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350084.223625:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e374b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded348 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.223689:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3752 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.223702:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.223715:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.223729:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e3759 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.223773:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e3759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.223781:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e3759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.223900:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cca00/0xd05e6ae1590e3760 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.223909:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cca00/0xd05e6ae1590e3760 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.223916:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cca00/0xd05e6ae1590e3760 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350084.223955:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783350084.223973:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783350084.224067:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cca00/0xd05e6ae1590e3760 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224078:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224095:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3752 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224101:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224106:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582ccc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350084.224110:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224133:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3752 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224203:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c4400) 00010000:00010000:3.0:1783350084.224207:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350084.224211:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224217:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224232:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e3759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224238:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e3759 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224244:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e3759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224262:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350084.224265:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e3759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224271:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e3759 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224278:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ea2424c5300) 00010000:00010000:3.0:1783350084.224281:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350084.224284:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e3759 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224300:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e3759 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224334:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e374b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded348 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224346:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cca00/0xd05e6ae1590e3760 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded348 expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.224352:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:3.0:1783350084.224354:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783350084.224357:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cca00, rc 0) 00000100:00100000:3.0:1783350084.224424:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:15560:x1869977642725888:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 868us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350084.224432:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:1.0:1783350084.227451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350084.232475:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642726016 00000100:00100000:0.0:1783350084.232496:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642726016 00000100:00100000:0.0:1783350084.232567:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:0.0:1783350084.232577:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:15560:x1869977642726016:12345-192.168.203.50@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783350084.233210:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:15560:x1869977642726016:12345-192.168.203.50@tcp:900:lhsmtool_posix.0 Request processed in 633us (5768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350084.233219:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:1.0:1783350084.245021:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350084.245173:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642726272 00000100:00100000:3.0:1783350084.245183:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642726272 00000100:00100000:3.0:1783350084.245242:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:3.0:1783350084.245253:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:15560:x1869977642726272:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783350084.245274:0:19423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350084.245293:0:19423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e3767 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded34f expref: -99 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245387:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e376e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245403:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e376e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245427:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e376e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245474:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3775 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245482:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3775 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245490:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3775 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245598:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc000/0xd05e6ae1590e377c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245606:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc000/0xd05e6ae1590e377c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245612:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc000/0xd05e6ae1590e377c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350084.245621:0:19423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1783350084.245767:0:19423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e376e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245775:0:19423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e376e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245782:0:19423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e376e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245789:0:19423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350084.245799:0:19423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e376e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245808:0:19423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e376e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245819:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ea2424c5700) 00010000:00010000:3.0:1783350084.245822:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350084.245826:0:19423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e376e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245833:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e376e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245846:0:19423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3775 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245852:0:19423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3775 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245857:0:19423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3775 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245862:0:19423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582ccc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350084.245865:0:19423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3775 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245871:0:19423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3775 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245878:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ea2424c5300) 00010000:00010000:3.0:1783350084.245880:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350084.245889:0:19423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3775 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.245895:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e3775 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.247690:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e3767 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded34f expref: 10 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.247714:0:19423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc000/0xd05e6ae1590e377c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded34f expref: 9 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.247722:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea2424c5900) 00010000:00010000:3.0:1783350084.247724:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350084.247727:0:19423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cc000, rc 0) 00000100:00100000:3.0:1783350084.247845:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:15560:x1869977642726272:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 2593us (2831us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783350084.247853:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:3.0:1783350084.275020:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350084.275262:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642726400 00000100:00100000:0.0:1783350084.275272:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642726400 00000100:00100000:0.0:1783350084.275329:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:0.0:1783350084.275340:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:15560:x1869977642726400:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783350084.275452:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:15560:x1869977642726400:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 113us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350084.275459:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:1.0:1783350084.283429:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350084.283510:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642726528 00000100:00100000:0.0:1783350084.283519:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642726528 00000100:00100000:0.0:1783350084.283568:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:0.0:1783350084.283576:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:15560:x1869977642726528:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1783350084.290311:0:17088:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6696us 00000100:00100000:3.0:1783350084.291681:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.292106:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642726656 00000100:00100000:1.0:1783350084.292117:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642726656 00000100:00100000:1.0:1783350084.292216:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:1.0:1783350084.292227:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:15566:x1869977642726656:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783350084.292262:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350084.292283:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e378a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded356 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292348:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e3791 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292362:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e3791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292374:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e3791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292390:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e3798 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292397:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e3798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292405:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e3798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292453:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e3791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292471:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e3791 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292478:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e3791 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292483:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350084.292492:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e3791 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292500:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e3791 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292511:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c4400) 00010000:00010000:1.0:1783350084.292514:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350084.292518:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e3791 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292524:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e3791 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292539:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e3798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292544:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e3798 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292550:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e3798 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292555:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350084.292557:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e3798 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292562:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e3798 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292568:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ea2431f9f00) 00010000:00010000:1.0:1783350084.292570:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350084.292578:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e3798 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292583:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e3798 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292611:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e378a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded356 expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292621:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c4400) 00010000:00010000:1.0:1783350084.292623:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350084.292626:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e378a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded356 expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.292635:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8ca00, rc 0) 00000100:00100000:1.0:1783350084.292700:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:15566:x1869977642726656:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 476us (1027us total) trans 0 rc 301/301 00000100:00100000:1.0:1783350084.292707:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00010000:00010000:2.0:1783350084.292785:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783350084.298477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350084.298582:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642726784 00000100:00100000:3.0:1783350084.298591:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642726784 00000100:00100000:3.0:1783350084.298646:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:3.0:1783350084.298656:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:15566:x1869977642726784:12345-192.168.203.50@tcp:700:lfs.0 00000100:00100000:3.0:1783350084.298732:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:15566:x1869977642726784:12345-192.168.203.50@tcp:700:lfs.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350084.298739:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:3.0:1783350084.301072:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.301251:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642727040 00000100:00100000:1.0:1783350084.301261:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642727040 00000100:00100000:1.0:1783350084.301309:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:1.0:1783350084.301319:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:15566:x1869977642727040:12345-192.168.203.50@tcp:36:lfs.0 00010000:00010000:1.0:1783350084.301373:0:19423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350084.301398:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e36b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded2c3 expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.301417:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c4400) 00010000:00010000:1.0:1783350084.301429:0:19423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783350084.301497:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.301511:0:19423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded333 expref: 5 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.301519:0:19423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.301552:0:19423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded333 expref: 5 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.301566:0:19423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded333 expref: 5 pid: 17087 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350084.301581:0:19423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19423:1869977659579904:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783350084.301653:0:19423:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783350084.303769:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350084.304096:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642727168 00000100:00100000:2.0:1783350084.304106:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642727168 00010000:00010000:2.0:1783350084.304176:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded333 expref: 6 pid: 17087 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350084.304218:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:2.0:1783350084.304229:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2399:x1869977642727168:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783350084.304243:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783350084.304249:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded333 expref: 6 pid: 17087 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.304263:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded333 expref: 6 pid: 17087 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.304284:0:17072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c4400) 00010000:00010000:2.0:1783350084.304290:0:17072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.304300:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.304306:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.304338:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783350084.304397:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2399:x1869977642727168:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 170us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350084.304405:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00010000:00010000:1.0:1783350084.304525:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e600/0xd05e6ae1590e36f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded333 expref: 5 pid: 17087 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350084.304540:0:19423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19423:1869977659579904:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783350084.304558:0:19423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.304567:0:19423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.304574:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.304601:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.304610:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.304618:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.309834:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.309857:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.309869:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783350084.309887:0:19423:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026ecab21 reply state 000000000f583e0d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.309898:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.309906:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:3.0:1783350084.309909:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783350084.309913:0:19423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783350084.309919:0:19423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783350084.309928:0:19423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.309935:0:19423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.309941:0:19423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.309947:0:19423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350084.309952:0:19423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.309971:0:19423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.309982:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2424c4400) 00010000:00010000:3.0:1783350084.309995:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350084.310000:0:19423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.310007:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e379f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783350084.310026:0:19423:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026ecab21 reply state 000000000f583e0d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.310035:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.310040:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ea2431f9b00) 00010000:00010000:3.0:1783350084.310042:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783350084.310044:0:19423:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783350084.310179:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+10:15566:x1869977642727040:12345-192.168.203.50@tcp:36:lfs.0 Request processed in 8857us (9110us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783350084.310189:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:2.0:1783350084.329483:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:15560:x1869977642726528:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 45892us (46047us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350084.329504:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 26 00000040:00080000:0.0:1783350084.420861:0:17847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783350084.461260:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.461656:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642727296 00000100:00100000:1.0:1783350084.461666:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642727296 00000100:00100000:1.0:1783350084.461781:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:1.0:1783350084.461793:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+10:15574:x1869977642727296:12345-192.168.203.50@tcp:101:lctl.0 00010000:00010000:1.0:1783350084.461816:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350084.461838:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e37b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded35d expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.461924:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e37bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.461939:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e37bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.461950:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e37bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783350084.462005:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783350084.462010:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783350084.462043:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e37bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.462084:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e37b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded35d expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.462103:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d200/0xd05e6ae1590e37bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded35d expref: 11 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.462112:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2431f9f00) 00010000:00010000:1.0:1783350084.462115:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783350084.462119:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8d200, rc 0) 00000100:00100000:1.0:1783350084.462237:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+11:15574:x1869977642727296:12345-192.168.203.50@tcp:101:lctl.0 Request processed in 445us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350084.462245:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:3.0:1783350084.500414:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.500573:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642727424 00000100:00100000:1.0:1783350084.500584:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642727424 00000100:00100000:1.0:1783350084.500648:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:1.0:1783350084.500658:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea370d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:15575:x1869977642727424:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1783350084.500678:0:19423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350084.500698:0:19423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e37c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded364 expref: -99 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.500769:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e37c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.500783:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e37c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.500795:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e37c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783350084.500851:0:19423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783350084.500856:0:19423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783350084.500881:0:19423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e37c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.500905:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e37c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded364 expref: 7 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.501100:0:19423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c200/0xd05e6ae1590e37c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded364 expref: 6 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.501111:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2431f9f00) 00010000:00010000:1.0:1783350084.501113:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783350084.501117:0:19423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36dd8c200, rc 0) 00000100:00100000:1.0:1783350084.501283:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea370d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:15575:x1869977642727424:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 625us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350084.501292:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:0.0:1783350084.507304:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350084.507406:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642727552 00000100:00100000:3.0:1783350084.507417:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642727552 00000100:00100000:3.0:1783350084.507475:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:3.0:1783350084.507485:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:15575:x1869977642727552:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783350084.507505:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350084.507530:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded36b expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507593:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e37d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507606:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e37d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507618:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e37d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507629:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e37de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507636:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e37de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507642:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e37de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507704:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e37e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507711:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e37e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507718:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e37e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350084.507749:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783350084.507752:0:17087:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783350084.507769:0:17087:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e37e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507786:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e37d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507792:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e37d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507799:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e37d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507805:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350084.507809:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e37d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507816:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e37d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507827:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2431f9f00) 00010000:00010000:3.0:1783350084.507829:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350084.507834:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e37d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507839:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e37d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507850:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e37de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507856:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e37de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507862:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e37de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507871:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cda00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350084.507874:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e37de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507880:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e37de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507888:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ea2431f9b00) 00010000:00010000:3.0:1783350084.507890:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350084.507893:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e37de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507899:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e37de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507935:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded36b expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507947:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e37e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded36b expref: 7 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.507954:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:3.0:1783350084.507956:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783350084.507959:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd200, rc 0) 00000100:00100000:3.0:1783350084.508013:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+7:15575:x1869977642727552:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 530us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350084.508021:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:3.0:1783350084.510663:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.510751:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642727680 00000100:00100000:1.0:1783350084.510760:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642727680 00000100:00100000:1.0:1783350084.510815:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:1.0:1783350084.510825:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea241da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:15575:x1869977642727680:12345-192.168.203.50@tcp:900:lfs.0 00000100:00100000:1.0:1783350084.510906:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea241da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:15575:x1869977642727680:12345-192.168.203.50@tcp:900:lfs.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350084.510928:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:0.0:1783350084.513619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350084.513737:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642727936 00000100:00100000:2.0:1783350084.513746:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642727936 00000100:00100000:2.0:1783350084.513804:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:2.0:1783350084.513815:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+7:15575:x1869977642727936:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783350084.513834:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350084.513851:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e37ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded372 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350084.514184:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783350084.514285:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e37ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded372 expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.514300:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2431f9f00) 00010000:00010000:2.0:1783350084.514303:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783350084.514308:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e37ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded372 expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.514321:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f000, rc 0) 00000100:00100000:2.0:1783350084.514491:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+8:15575:x1869977642727936:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 677us (879us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1783350084.514498:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:2.0:1783350084.527196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350084.527312:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642728192 00000100:00100000:3.0:1783350084.527322:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642728192 00000100:00100000:3.0:1783350084.527390:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:3.0:1783350084.527401:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+8:15575:x1869977642728192:12345-192.168.203.50@tcp:36:lfs.0 00010000:00010000:3.0:1783350084.527456:0:17087:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350084.527483:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e37e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded36b expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.527501:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:3.0:1783350084.527506:0:17087:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783350084.527527:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.527539:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.527548:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783350084.527729:0:17087:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb354568 reply state 0000000040a35a10 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.527743:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.527749:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:3.0:1783350084.527752:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1783350084.527754:0:17087:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783350084.527761:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783350084.527829:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+9:15575:x1869977642728192:12345-192.168.203.50@tcp:36:lfs.0 Request processed in 429us (642us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783350084.527850:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:0.0:1783350084.536264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.536473:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642728448 00000100:00100000:1.0:1783350084.536483:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642728448 00000100:00100000:1.0:1783350084.536542:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:1.0:1783350084.536564:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+9:15575:x1869977642728448:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1783350084.536780:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+10:15575:x1869977642728448:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 218us (525us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783350084.536789:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:0.0:1783350084.542414:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350084.542506:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642728704 00000100:00100000:2.0:1783350084.542516:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642728704 00000100:00100000:2.0:1783350084.542577:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:2.0:1783350084.542587:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+10:15575:x1869977642728704:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1783350084.542610:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350084.542629:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e3801 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded379 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542701:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3808 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542715:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542725:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542735:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e380f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542742:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e380f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542748:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e380f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350084.542850:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783350084.542949:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542957:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3808 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542963:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542968:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350084.542973:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542979:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3808 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.542992:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2431f9f00) 00010000:00010000:2.0:1783350084.542995:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350084.543000:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543005:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543019:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e380f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543024:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e380f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543031:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e380f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543047:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350084.543050:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e380f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543056:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e380f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543065:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ea2431f9b00) 00010000:00010000:2.0:1783350084.543067:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350084.543069:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e380f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543076:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e380f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543108:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e3801 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded379 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543118:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2431f9f00) 00010000:00010000:2.0:1783350084.543120:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783350084.543132:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e3801 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded379 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.543209:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f000, rc 0) 00000100:00100000:2.0:1783350084.543266:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+11:15575:x1869977642728704:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 680us (860us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1783350084.543273:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:0.0:1783350084.552927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350084.553006:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642728832 00000100:00100000:3.0:1783350084.553015:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642728832 00000100:00100000:3.0:1783350084.553069:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:3.0:1783350084.553079:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+11:15575:x1869977642728832:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783350084.553101:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350084.553119:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e381d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded380 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.553257:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.553273:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.553284:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350084.553310:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783350084.553314:0:17087:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783350084.553333:0:17087:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.553358:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e381d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded380 expref: 13 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.553574:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded380 expref: 12 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.553601:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:3.0:1783350084.553604:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783350084.553607:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cda00, rc 0) 00000100:00100000:3.0:1783350084.553661:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+12:15575:x1869977642728832:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 582us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350084.553669:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:0.0:1783350084.559969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.560042:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642728960 00000100:00100000:1.0:1783350084.560052:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642728960 00000100:00100000:1.0:1783350084.560117:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:1.0:1783350084.560128:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+12:15575:x1869977642728960:12345-192.168.203.50@tcp:37:lfs.0 00000100:00100000:1.0:1783350084.565575:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+12:15575:x1869977642728960:12345-192.168.203.50@tcp:37:lfs.0 Request processed in 5440us (5606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350084.565588:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1783350084.570659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350084.570753:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642729216 00000100:00100000:2.0:1783350084.570775:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642729216 00000100:00100000:2.0:1783350084.570831:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:2.0:1783350084.570840:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243033050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+12:15575:x1869977642729216:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783350084.571061:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243033050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+13:15575:x1869977642729216:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 221us (411us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783350084.571069:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:0.0:1783350084.635544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350084.635637:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642729344 00000100:00100000:2.0:1783350084.635648:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642729344 00000100:00100000:2.0:1783350084.635707:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:2.0:1783350084.635718:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+11:15581:x1869977642729344:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783350084.635738:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350084.635757:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e382b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded387 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.635823:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e3832 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.635838:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e3832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.635849:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e3832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.635860:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3839 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.635867:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.635874:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.635956:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e3840 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.635965:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e3840 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.635973:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e3840 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350084.636008:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783350084.636012:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350084.636047:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e3840 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636059:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e3832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636065:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e3832 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636072:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e3832 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636078:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350084.636083:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e3832 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636090:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e3832 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636102:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2431f9f00) 00010000:00010000:2.0:1783350084.636111:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350084.636116:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e3832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636123:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e000/0xd05e6ae1590e3832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636189:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636197:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3839 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636203:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636208:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350084.636212:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636218:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3839 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636226:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ea2431f9b00) 00010000:00010000:2.0:1783350084.636229:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350084.636232:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3839 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636238:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3839 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636265:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e382b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded387 expref: 13 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636291:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ec00/0xd05e6ae1590e3840 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded387 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.636299:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:2.0:1783350084.636301:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783350084.636304:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ec00, rc 0) 00000100:00100000:2.0:1783350084.636355:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+12:15581:x1869977642729344:12345-192.168.203.50@tcp:101:bash.0 Request processed in 639us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350084.636373:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:0.0:1783350084.643728:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.643805:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642729472 00000100:00100000:1.0:1783350084.643815:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642729472 00000100:00100000:1.0:1783350084.643874:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:1.0:1783350084.643884:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:15581:x1869977642729472:12345-192.168.203.50@tcp:900:bash.0 00000100:00100000:1.0:1783350084.643968:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:15581:x1869977642729472:12345-192.168.203.50@tcp:900:bash.0 Request processed in 86us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350084.643976:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1783350084.647755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.648349:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642729728 00000100:00100000:1.0:1783350084.648359:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642729728 00000100:00100000:1.0:1783350084.648414:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:1.0:1783350084.648422:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2444efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+12:15581:x1869977642729728:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1783350084.648441:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350084.648459:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e3847 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded38e expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.648576:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.648591:0:17089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded380 expref: 12 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.648599:0:17089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.648628:0:17089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded380 expref: 12 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.648638:0:17089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded380 expref: 12 pid: 17087 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350084.648649:0:17089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea36cce8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17089:1869977659580032:192.168.203.50@tcp:104: 00000100:00100000:1.0:1783350084.648988:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea348cf1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783350084.659236:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350084.659852:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642729856 00000100:00100000:0.0:1783350084.659862:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642729856 00010000:00010000:0.0:1783350084.659901:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded380 expref: 13 pid: 17087 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350084.659935:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:0.0:1783350084.659944:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+13:2400:x1869977642729856:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350084.659957:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350084.659964:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded380 expref: 13 pid: 17087 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350084.659977:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded380 expref: 13 pid: 17087 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350084.660012:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:0.0:1783350084.660017:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350084.660027:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350084.660047:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350084.660067:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350084.660176:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07a332e1-ec8f-4f86-8530-dd43a8d09e28+13:2400:x1869977642729856:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 232us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350084.660183:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00010000:00010000:1.0:1783350084.660935:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cda00/0xd05e6ae1590e3824 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded380 expref: 12 pid: 17087 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350084.660958:0:17089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea36cce8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17089:1869977659580032:192.168.203.50@tcp:104: 00010000:00010000:1.0:1783350084.660979:0:17089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.660989:0:17089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.661020:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.661046:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.661057:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.661066:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662529:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662546:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662556:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783350084.662577:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783350084.662611:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662619:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662625:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662632:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350084.662836:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662846:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662859:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:1.0:1783350084.662864:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350084.662869:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662876:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c000/0xd05e6ae1590e384e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783350084.662892:0:17089:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000246d650b reply state 00000000b622ad2f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662903:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662908:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ea2431f9e00) 00010000:00010000:1.0:1783350084.662911:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783350084.662914:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783350084.662951:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8ca00/0xd05e6ae1590e3847 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded38e expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662966:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded38e expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350084.662973:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:1.0:1783350084.662975:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783350084.662984:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374603000, rc 0) 00000100:00100000:1.0:1783350084.663064:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2444efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+15:15581:x1869977642729728:12345-192.168.203.50@tcp:101:bash.0 Request processed in 14641us (15316us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783350084.663073:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:3.0:1783350084.684731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350084.685112:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642729984 00000100:00100000:2.0:1783350084.685124:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642729984 00000100:00100000:2.0:1783350084.685242:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:2.0:1783350084.685253:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+15:15581:x1869977642729984:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1783350084.685279:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350084.685299:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e386a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded395 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.685381:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.685397:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.685409:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350084.685460:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783350084.685477:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350084.685499:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.685682:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.685708:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e386a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded395 expref: 17 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.685728:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded395 expref: 16 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350084.685737:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:2.0:1783350084.685740:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783350084.685744:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f600, rc 0) 00000100:00100000:0.0:1783350084.685865:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+16:15581:x1869977642729984:12345-192.168.203.50@tcp:101:bash.0 Request processed in 612us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350084.685874:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:2.0:1783350084.704900:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.705024:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642730240 00000100:00100000:1.0:1783350084.705034:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642730240 00000100:00100000:1.0:1783350084.705434:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:1.0:1783350084.705447:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+16:15581:x1869977642730240:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:1.0:1783350084.705738:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+17:15581:x1869977642730240:12345-192.168.203.50@tcp:35:bash.0 Request processed in 294us (847us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1783350084.705747:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1783350084.867696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350084.867963:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642730496 00000100:00100000:3.0:1783350084.867973:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642730496 00000100:00100000:3.0:1783350084.868032:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:3.0:1783350084.868041:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+17:15591:x1869977642730496:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1783350084.868077:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350084.868098:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e3878 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded39c expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350084.868248:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783350084.868346:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e3878 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded39c expref: 19 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.868503:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ea2431f9f00) 00010000:00010000:3.0:1783350084.868506:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783350084.868513:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e3878 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded39c expref: 19 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.868528:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd200, rc 0) 00000100:00100000:3.0:1783350084.868599:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+18:15591:x1869977642730496:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 559us (911us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1783350084.868607:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:3.0:1783350084.874713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350084.874912:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642730752 00000100:00100000:1.0:1783350084.874922:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642730752 00000100:00100000:1.0:1783350084.874994:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:1.0:1783350084.875005:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+18:15591:x1869977642730752:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1783350084.875274:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+19:15591:x1869977642730752:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 270us (572us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783350084.875282:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:2.0:1783350084.933728:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350084.933820:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642731008 00000100:00100000:0.0:1783350084.933829:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642731008 00000100:00100000:0.0:1783350084.933889:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:0.0:1783350084.933899:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+19:15594:x1869977642731008:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1783350084.933924:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350084.933947:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3886 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3a3 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350084.934056:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e388d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350084.934069:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e388d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350084.934080:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e388d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783350084.934090:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783350084.934255:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3886 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3a3 expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350084.934273:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e388d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3a3 expref: 21 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350084.934281:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350084.934284:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783350084.934287:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364be00, rc 0) 00000100:00100000:0.0:1783350084.934353:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+21:15594:x1869977642731008:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 455us (633us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1783350084.934359:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:2.0:1783350084.938775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350084.943186:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642731136 00000100:00100000:3.0:1783350084.943201:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642731136 00000100:00100000:3.0:1783350084.943263:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:3.0:1783350084.943274:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+21:2402:x1869977642731136:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783350084.943290:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783350084.943313:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e388d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3a3 expref: 21 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.943333:0:17072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:3.0:1783350084.943338:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783350084.945536:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+20:2402:x1869977642731136:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 2253us (6759us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350084.945551:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:2.0:1783350084.945709:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350084.949592:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642731264 00000100:00100000:3.0:1783350084.949609:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642731264 00000100:00100000:3.0:1783350084.949683:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:3.0:1783350084.949694:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+20:15594:x1869977642731264:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1783350084.949757:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e389b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.949775:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e389b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.949788:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e389b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.949839:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e389b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.949846:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e389b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.949854:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e389b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.949860:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350084.949865:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e389b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.949872:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e389b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.949884:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:3.0:1783350084.949887:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783350084.949891:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e389b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350084.949896:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e389b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350084.950029:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+20:15594:x1869977642731264:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 337us (4319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350084.950038:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:1.0:1783350084.958674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350084.959395:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642731520 00000100:00100000:2.0:1783350084.959407:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642731520 00000100:00100000:2.0:1783350084.959470:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:2.0:1783350084.959481:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+20:15594:x1869977642731520:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1783350084.960240:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+21:15594:x1869977642731520:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 757us (1570us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1783350084.960250:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000040:00080000:2.0:1783350085.252830:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783350085.263627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350085.263711:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642731776 00000100:00100000:3.0:1783350085.263720:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642731776 00000100:00100000:3.0:1783350085.263794:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:3.0:1783350085.263817:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+21:15625:x1869977642731776:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:3.0:1783350085.263844:0:19423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350085.263985:0:19423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e38a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3aa expref: -99 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.264102:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e38a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.264116:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e38a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.264132:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e38a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783350085.264181:0:19423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00080000:2.0:1783350085.264257:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783350085.264305:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e38a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3aa expref: 24 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.264424:0:19423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e38a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3aa expref: 23 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.264434:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:3.0:1783350085.264437:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783350085.264441:0:19423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cd000, rc 0) 00000100:00100000:3.0:1783350085.264609:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+23:15625:x1869977642731776:12345-192.168.203.50@tcp:101:cat.0 Request processed in 793us (990us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1783350085.264616:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:3.0:1783350085.266881:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350085.267082:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642731904 00000100:00100000:1.0:1783350085.267092:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642731904 00000100:00100000:1.0:1783350085.267588:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:1.0:1783350085.267600:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+23:2400:x1869977642731904:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783350085.267617:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350085.267641:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd000/0xd05e6ae1590e38a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3aa expref: 23 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.267678:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:1.0:1783350085.267683:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350085.267745:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+22:2400:x1869977642731904:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 148us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350085.267752:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:1.0:1783350085.270498:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350085.270581:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642732160 00000100:00100000:0.0:1783350085.270590:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642732160 00000100:00100000:0.0:1783350085.270654:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:0.0:1783350085.270663:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36ccebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+22:15625:x1869977642732160:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:0.0:1783350085.271428:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36ccebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+23:15625:x1869977642732160:12345-192.168.203.50@tcp:35:cat.0 Request processed in 762us (934us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1783350085.271438:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00010000:00010000:3.0:1783350085.316258:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350085.369106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350085.369295:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642732416 00000100:00100000:3.0:1783350085.369306:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642732416 00000100:00100000:3.0:1783350085.369371:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:3.0:1783350085.369381:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+23:15631:x1869977642732416:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:3.0:1783350085.369405:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783350085.369422:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e38b7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3b1 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.369599:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.369613:0:17087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded38e expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.369779:0:17087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded395 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.369791:0:17087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.369825:0:17087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded395 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.369839:0:17087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded395 expref: 24 pid: 17088 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350085.369853:0:17087:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17087:1869977659580160:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783350085.370053:0:17087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded38e expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350085.370077:0:17087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded38e expref: 24 pid: 17089 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350085.370086:0:17087:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17087:1869977659580288:192.168.203.50@tcp:104: 00000100:00100000:3.0:1783350085.370122:0:17087:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3455c53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783350085.378843:0:17087:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f538000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17087:1869977659580160:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783350085.378858:0:17087:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f53a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17087:1869977659580288:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783350085.378884:0:17087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350085.380043:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350085.380082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350085.380671:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642732544 00000100:00100000:0.0:1783350085.380682:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642732544 00010000:00010000:0.0:1783350085.380719:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded395 expref: 25 pid: 17088 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350085.380818:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642732672 00000100:00100000:0.0:1783350085.380822:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642732672 00010000:00010000:0.0:1783350085.380837:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded38e expref: 26 pid: 17089 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350085.380855:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:0.0:1783350085.380863:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+26:2399:x1869977642732544:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350085.380877:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350085.380883:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded395 expref: 26 pid: 17088 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.380895:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded395 expref: 26 pid: 17088 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.380914:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3871 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded395 expref: 26 pid: 17088 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.380929:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350085.380934:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.380942:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.380948:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350085.381001:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+25:2399:x1869977642732544:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 138us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350085.381018:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:0.0:1783350085.381038:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:0.0:1783350085.381044:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243255850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+24:2399:x1869977642732672:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350085.381052:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350085.381058:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded38e expref: 24 pid: 17089 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.381068:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded38e expref: 24 pid: 17089 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.381080:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603000/0xd05e6ae1590e385c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded38e expref: 24 pid: 17089 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.381089:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350085.381093:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.381100:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.381108:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.381674:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350085.381706:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243255850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+23:2399:x1869977642732672:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 659us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350085.381713:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00010000:00010000:0.0:1783350085.381782:0:17087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.381790:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783350085.381808:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783350085.381942:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd200/0xd05e6ae1590e38b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b1 expref: 24 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.381958:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cde00/0xd05e6ae1590e38be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b1 expref: 23 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.381976:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350085.381979:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783350085.381981:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea3582cde00, rc 0) 00000100:00100000:0.0:1783350085.382064:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+23:15631:x1869977642732416:12345-192.168.203.50@tcp:101:dd.0 Request processed in 12685us (12966us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1783350085.382072:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:3.0:1783350085.386126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350085.386421:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642732800 00000100:00100000:0.0:1783350085.386431:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642732800 00000100:00100000:0.0:1783350085.386496:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:0.0:1783350085.386506:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+23:15631:x1869977642732800:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:0.0:1783350085.386529:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350085.386549:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e38cc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3b8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.386583:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.386615:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.386625:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.386732:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e38cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b8 expref: 25 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.386750:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b8 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.386760:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350085.386763:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783350085.386766:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364be00, rc 0) 00000100:00100000:0.0:1783350085.386819:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+24:15631:x1869977642732800:12345-192.168.203.50@tcp:101:dd.0 Request processed in 313us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350085.386826:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:2.0:1783350085.392496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350085.392551:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642733056 00000100:00100000:1.0:1783350085.392560:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642733056 00000100:00100000:1.0:1783350085.392630:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:1.0:1783350085.392640:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+24:15631:x1869977642733056:12345-192.168.203.50@tcp:36:dd.0 00010000:00010000:1.0:1783350085.392871:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.392888:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.392899:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783350085.392952:0:17089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1783350085.392976:0:17089:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000968a72da reply state 000000005ae20400 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.392994:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.393001:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:1.0:1783350085.393003:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783350085.393017:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783350085.393314:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+27:15631:x1869977642733056:12345-192.168.203.50@tcp:36:dd.0 Request processed in 674us (826us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1783350085.393322:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00000020:00080000:1.0:1783350085.393327:0:17089:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783350085.397373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350085.397743:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642733184 00000100:00100000:0.0:1783350085.397811:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642733184 00000100:00100000:0.0:1783350085.397876:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:0.0:1783350085.397886:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+27:15631:x1869977642733184:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:0.0:1783350085.397909:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350085.397927:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e38e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3bf expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.398592:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e38e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3bf expref: 28 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.398695:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e38e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3bf expref: 28 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.398718:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350085.398721:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783350085.398724:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a200, rc 0) 00000100:00100000:0.0:1783350085.398869:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+28:15631:x1869977642733184:12345-192.168.203.50@tcp:101:dd.0 Request processed in 982us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350085.398877:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:3.0:1783350085.410687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350085.410831:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642733440 00000100:00100000:0.0:1783350085.410841:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642733440 00000100:00100000:0.0:1783350085.410904:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:0.0:1783350085.410914:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+28:15631:x1869977642733440:12345-192.168.203.50@tcp:103:dd.0 00010000:00010000:0.0:1783350085.410933:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350085.410957:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e38e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3bf expref: 28 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350085.410976:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350085.410981:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350085.411035:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+27:15631:x1869977642733440:12345-192.168.203.50@tcp:103:dd.0 Request processed in 123us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350085.411043:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:2.0:1783350085.420328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350085.420505:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642733568 00000100:00100000:1.0:1783350085.420514:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642733568 00000100:00100000:1.0:1783350085.420574:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:1.0:1783350085.420584:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+27:15631:x1869977642733568:12345-192.168.203.50@tcp:58:dd.0 00010000:00010000:1.0:1783350085.420700:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.420718:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.420730:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783350085.422935:0:17089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783350085.423485:0:17089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1783350085.423639:0:17089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1783350085.423796:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+27:15631:x1869977642733568:12345-192.168.203.50@tcp:58:dd.0 Request processed in 3208us (3471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350085.423807:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:3.0:1783350085.427968:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350085.428055:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642733696 00000100:00100000:1.0:1783350085.428065:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642733696 00000100:00100000:1.0:1783350085.428166:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:1.0:1783350085.428178:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+27:15631:x1869977642733696:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:1.0:1783350085.428198:0:19423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783350085.428218:0:19423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602e00/0xd05e6ae1590e38ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3c6 expref: -99 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.428290:0:19423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.428302:0:19423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602e00/0xd05e6ae1590e38ef lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3c6 expref: 28 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.428321:0:19423:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.428335:0:19423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602e00/0xd05e6ae1590e38ef lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3c6 expref: 28 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.428348:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:1.0:1783350085.428351:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783350085.428354:0:19423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602e00/0xd05e6ae1590e38ef lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3c6 expref: 28 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350085.428375:0:19423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea374602e00, rc 0) 00000100:00100000:1.0:1783350085.428926:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+28:15631:x1869977642733696:12345-192.168.203.50@tcp:101:dd.0 Request processed in 747us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350085.428936:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00000040:00080000:2.0:1783350086.276393:0:17125:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783350086.276402:0:17125:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783350086.276431:0:17125:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783350086.276440:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783350086.276561:0:17125:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17125:1869977659580416:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783350086.276664:0:17125:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3461e89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350086.287875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.288002:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642733824 00000100:00100000:0.0:1783350086.288012:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642733824 00000100:00100000:0.0:1783350086.288070:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:0.0:1783350086.288080:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+29:15632:x1869977642733824:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783350086.288178:0:17087:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783350086.288575:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+29:15632:x1869977642733824:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 494us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350086.288583:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:1.0:1783350086.289010:0:17125:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244776300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17125:1869977659580416:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783350086.299190:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.299444:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642733952 00000100:00100000:2.0:1783350086.299455:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642733952 00000100:00100000:2.0:1783350086.299515:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:2.0:1783350086.299525:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24465d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+28:15632:x1869977642733952:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783350086.299603:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e38f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299619:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e38f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299633:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e38f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299684:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e38fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299704:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e38fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299712:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e38fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299736:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299745:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299752:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350086.299795:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783350086.299800:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350086.299816:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299826:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e38f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299832:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e38f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299838:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e38f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299843:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350086.299846:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e38f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299859:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e38f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299883:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea2424c5900) 00010000:00010000:2.0:1783350086.299886:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350086.299891:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e38f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299897:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e38f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299912:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e38fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299918:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e38fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299925:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e38fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299930:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8f000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350086.299933:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e38fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299939:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e38fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299945:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ea2424c4d00) 00010000:00010000:2.0:1783350086.299947:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350086.299950:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e38fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299966:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e38fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299981:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299987:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299993:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.299997:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350086.299999:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.300005:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.300012:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:2.0:1783350086.300015:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350086.300018:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.300023:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3904 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350086.300099:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24465d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+28:15632:x1869977642733952:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 574us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350086.300108:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:3.0:1783350086.309531:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.309628:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642734208 00000100:00100000:0.0:1783350086.309637:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642734208 00000100:00100000:0.0:1783350086.309694:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:0.0:1783350086.309704:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+28:15632:x1869977642734208:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783350086.309732:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350086.309749:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e390b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3cd expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.309851:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3912 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.309878:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3912 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.309889:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3912 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783350086.309901:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783350086.309976:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3912 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.309984:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3912 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.310007:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3912 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.310013:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364ba00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:0.0:1783350086.310017:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3912 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.310024:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3912 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.310036:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:0.0:1783350086.310039:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783350086.310043:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3912 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.310049:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3912 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.310093:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e390b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3cd expref: 30 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.310103:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ea2424c5900) 00010000:00010000:0.0:1783350086.310106:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783350086.310109:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e390b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3cd expref: 30 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.310118:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b400, rc 0) 00000100:00100000:0.0:1783350086.310468:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+29:15632:x1869977642734208:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 764us (944us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1783350086.310484:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:3.0:1783350086.318074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.318449:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642734336 00000100:00100000:2.0:1783350086.318460:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642734336 00000100:00100000:2.0:1783350086.318518:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:2.0:1783350086.318527:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+29:15632:x1869977642734336:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783350086.318572:0:17088:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783350086.319078:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+29:15632:x1869977642734336:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 550us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350086.319087:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:3.0:1783350086.322167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.324869:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642734592 00000100:00100000:0.0:1783350086.324885:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642734592 00000100:00100000:0.0:1783350086.324960:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:0.0:1783350086.324970:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+29:15632:x1869977642734592:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783350086.324990:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350086.325010:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3920 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3d4 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783350086.325785:0:17087:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:0.0:1783350086.325794:0:17087:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1783350086.325818:0:17087:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1783350086.325967:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3927 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.325981:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.325991:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.326041:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3920 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3d4 expref: 32 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.326058:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3927 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3d4 expref: 31 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.326066:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b500) 00010000:00010000:0.0:1783350086.326080:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783350086.326084:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364ba00, rc 0) 00000100:00100000:0.0:1783350086.326430:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+31:15632:x1869977642734592:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 1458us (4317us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1783350086.326438:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:3.0:1783350086.334375:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350086.334669:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642734848 00000100:00100000:1.0:1783350086.334679:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642734848 00000100:00100000:1.0:1783350086.334730:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:1.0:1783350086.334740:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+31:15632:x1869977642734848:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783350086.334814:0:19423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350086.334840:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364ba00/0xd05e6ae1590e3927 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3d4 expref: 31 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.334857:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b500) 00010000:00010000:1.0:1783350086.334869:0:19423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783350086.334891:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602800/0xd05e6ae1590e3935 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.334904:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602800/0xd05e6ae1590e3935 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.334913:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602800/0xd05e6ae1590e3935 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.334972:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e393c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xce660466 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.334980:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e393c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xce660466 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.334988:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e393c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xce660466 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335030:0:19423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602800/0xd05e6ae1590e3935 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335037:0:19423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602800/0xd05e6ae1590e3935 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335044:0:19423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602800/0xd05e6ae1590e3935 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335057:0:19423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350086.335061:0:19423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602800/0xd05e6ae1590e3935 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335068:0:19423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602800/0xd05e6ae1590e3935 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335077:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:1.0:1783350086.335080:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350086.335083:0:19423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602800/0xd05e6ae1590e3935 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335088:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602800/0xd05e6ae1590e3935 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335098:0:19423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e393c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xce660466 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335103:0:19423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e393c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xce660466 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335108:0:19423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e393c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xce660466 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335112:0:19423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374603600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350086.335115:0:19423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e393c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xce660466 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335119:0:19423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e393c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xce660466 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335164:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xce660466 (ffff8ea2431f9900) 00010000:00010000:1.0:1783350086.335166:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783350086.335169:0:19423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e393c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xce660466 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.335175:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e393c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xce660466 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350086.335258:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+30:15632:x1869977642734848:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 514us (885us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783350086.335266:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 54 00010000:00010000:1.0:1783350086.341529:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350086.343424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.343598:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642734976 00000100:00100000:0.0:1783350086.343609:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642734976 00000100:00100000:0.0:1783350086.343681:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:0.0:1783350086.343692:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+30:15632:x1869977642734976:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783350086.343712:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350086.343734:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3943 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3db expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.343768:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e394a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.343781:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e394a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.343792:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e394a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.343903:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3943 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3db expref: 32 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.343920:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364a200/0xd05e6ae1590e394a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3db expref: 31 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.343929:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:0.0:1783350086.343939:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783350086.343943:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364a200, rc 0) 00000100:00100000:0.0:1783350086.344002:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+31:15632:x1869977642734976:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 311us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350086.344289:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:3.0:1783350086.347589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350086.347715:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642735232 00000100:00100000:1.0:1783350086.347724:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642735232 00000100:00100000:1.0:1783350086.347775:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:1.0:1783350086.347784:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+31:15632:x1869977642735232:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783350086.347854:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.347869:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.347880:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783350086.348023:0:19423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1783350086.348031:0:19423:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 527142894675ns, next at 528142892912ns, rc = 0 00000004:00010000:1.0:1783350086.348074:0:19423:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044de61b9 reply state 000000007acde851 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.348097:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.348105:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:1.0:1783350086.348122:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783350086.348126:0:19423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783350086.348251:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+33:15632:x1869977642735232:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 467us (669us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1783350086.348258:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:3.0:1783350086.355760:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.355904:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642735360 00000100:00100000:2.0:1783350086.355913:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642735360 00000100:00100000:2.0:1783350086.355967:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:2.0:1783350086.355976:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+33:15632:x1869977642735360:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783350086.355997:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350086.356016:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3958 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3e2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.356067:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3958 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e2 expref: 34 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.356081:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3958 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e2 expref: 34 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.356097:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:2.0:1783350086.356100:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783350086.356104:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8e400, rc 0) 00000100:00100000:2.0:1783350086.356206:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+34:15632:x1869977642735360:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 231us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350086.356228:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:0.0:1783350086.361937:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350086.362033:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642735488 00000100:00100000:1.0:1783350086.362042:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642735488 00000100:00100000:1.0:1783350086.362167:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:1.0:1783350086.362179:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2399:x1869977642735488:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783350086.362396:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea24477ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2399:x1869977642735488:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 219us (468us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1783350086.362403:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00080000:2.0:1783350086.363468:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350086.366529:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.366915:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642735744 00000100:00100000:2.0:1783350086.366925:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642735744 00000100:00100000:2.0:1783350086.366989:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:2.0:1783350086.366998:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+34:15632:x1869977642735744:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783350086.367284:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+35:15632:x1869977642735744:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 286us (763us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1783350086.367293:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:0.0:1783350086.375271:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350086.375465:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642736000 00000100:00100000:1.0:1783350086.375475:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642736000 00000100:00100000:1.0:1783350086.375537:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:1.0:1783350086.375546:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+35:15632:x1869977642736000:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783350086.375660:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+35:15632:x1869977642736000:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 114us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350086.375668:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:3.0:1783350086.378397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.378583:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642736128 00000100:00100000:2.0:1783350086.378593:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642736128 00000100:00100000:2.0:1783350086.378663:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:2.0:1783350086.378673:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+35:15632:x1869977642736128:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783350086.378694:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350086.378712:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e395f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3e9 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.378781:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3966 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.378795:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.378806:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783350086.378848:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783350086.378885:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.378910:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f000/0xd05e6ae1590e395f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e9 expref: 37 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.378928:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3966 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e9 expref: 36 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.378936:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:2.0:1783350086.378939:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783350086.378944:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f600, rc 0) 00000100:00100000:2.0:1783350086.379002:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+36:15632:x1869977642736128:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 330us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350086.379010:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:3.0:1783350086.383008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.383098:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642736256 00000100:00100000:0.0:1783350086.383107:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642736256 00000100:00100000:0.0:1783350086.383201:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:0.0:1783350086.383212:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2400:x1869977642736256:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783350086.383230:0:18595:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783350086.383256:0:18595:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089ae184e/0xd05e6ae1590e396d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3f0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783350086.383287:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc345, blocks: 0x0 00010000:00010000:0.0:1783350086.383306:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1783350086.383311:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350086.383320:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ae184e/0xd05e6ae1590e396d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f0 expref: 7 pid: 18595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.383337:0:18595:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089ae184e/0xd05e6ae1590e396d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f0 expref: 7 pid: 18595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.383350:0:18595:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea24364b400, rc 0) 00000100:00100000:0.0:1783350086.383419:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:2400:x1869977642736256:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 209us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350086.383440:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:3.0:1783350086.386986:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350086.387219:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642736512 00000100:00100000:1.0:1783350086.387231:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642736512 00000100:00100000:1.0:1783350086.387296:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:1.0:1783350086.387320:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+36:15632:x1869977642736512:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783350086.387449:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+36:15632:x1869977642736512:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 130us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350086.387456:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:3.0:1783350086.390964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.391052:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642736640 00000100:00100000:2.0:1783350086.391062:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642736640 00000100:00100000:2.0:1783350086.391122:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:2.0:1783350086.391174:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+36:15632:x1869977642736640:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783350086.393692:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1783350086.393708:0:17067:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1783350086.393753:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1783350086.393887:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+19:15632:x1869977642736640:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 2751us (2927us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350086.393897:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00010000:00010000:3.0:1783350086.394075:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394087:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394095:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394113:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8c800 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350086.394118:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394158:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394175:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ea2431f9b00) 00010000:00010000:3.0:1783350086.394178:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350086.394183:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394190:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8c800/0xd05e6ae1590e37a6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394212:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394219:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394226:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394231:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cc200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350086.394234:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394240:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394276:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:3.0:1783350086.394278:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350086.394281:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394287:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cc200/0xd05e6ae1590e37ad lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394299:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394305:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394310:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394316:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36dd8d000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350086.394319:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394325:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394333:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ea2431f9e00) 00010000:00010000:3.0:1783350086.394335:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350086.394338:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394344:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36dd8d000/0xd05e6ae1590e3855 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394381:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394387:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394393:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394398:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602000 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350086.394401:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394408:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394416:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:3.0:1783350086.394419:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783350086.394422:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394428:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602000/0xd05e6ae1590e38da lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394439:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394445:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394451:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394464:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374603600 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:3.0:1783350086.394467:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394473:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394482:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:3.0:1783350086.394484:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783350086.394488:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.394494:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603600/0xd05e6ae1590e3951 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350086.395471:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783350086.395492:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659580544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783350086.395550:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783350086.395736:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.395746:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.395753:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.395759:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582ccc00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:1.0:1783350086.395762:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.395769:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.395781:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ea2424c5300) 00010000:00010000:1.0:1783350086.395783:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1783350086.395786:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.395792:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582ccc00/0xd05e6ae1590e37fa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350086.404671:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659580544 00000100:00100000:0.0:1783350086.404687:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659580544 00000100:00100000:0.0:1783350086.404808:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783350086.404819:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea244776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659580544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783350086.405366:0:18596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783350086.405371:0:18596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1783350086.405387:0:18596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783350086.405389:0:18596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1783350085 -> 1783350085 00002000:00010000:1.0:1783350086.405392:0:18596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783350086.405475:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea244776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1869977659580544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 657us (9923us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1783350086.405483:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1783350086.405770:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ea37f5c9500/2, rc 0, transno 8589934596 00000100:00100000:0.0:1783350086.405778:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659580544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783350086.405969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350086.406081:0:19527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642736768 00000100:00100000:3.0:1783350086.406088:0:19527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642736768 00000100:00100000:3.0:1783350086.406166:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:3.0:1783350086.406175:0:19527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:2399:x1869977642736768:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783350086.406958:0:19527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:2399:x1869977642736768:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350086.406969:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00080000:2.0:1783350086.409525:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350086.420911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1783350086.421019:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642737024 00000100:00100000:1.0:1783350086.421029:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642737024 00000100:00100000:1.0:1783350086.421093:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:1.0:1783350086.421103:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+15:15632:x1869977642737024:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783350086.421227:0:19423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350086.421404:0:19423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8f600/0xd05e6ae1590e3966 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e9 expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.421427:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:1.0:1783350086.421433:0:19423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783350086.421463:0:19423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.421476:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.421485:0:19423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783350086.421601:0:19423:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce89a3b7 reply state 000000006b56db52 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.421614:0:19423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374603800/0xd05e6ae1590e3974 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.421628:0:19423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:1.0:1783350086.421631:0:19423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783350086.421634:0:19423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783350086.421733:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+16:15632:x1869977642737024:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 630us (829us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1783350086.421742:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:1.0:1783350086.426464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.430744:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642737152 00000100:00100000:2.0:1783350086.430760:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642737152 00000100:00100000:2.0:1783350086.430884:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:2.0:1783350086.430894:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36cceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:15632:x1869977642737152:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783350086.430914:0:18594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350086.430932:0:18594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3f7 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.430970:0:18594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089ae184e/0xd05e6ae1590e396d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f0 expref: 8 pid: 18595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.430979:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350086.430983:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350086.430988:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 8 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.431023:0:18594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089ae184e/0xd05e6ae1590e396d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f0 expref: 8 pid: 18595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.431037:0:18594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089ae184e/0xd05e6ae1590e396d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f0 expref: 8 pid: 18595 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350086.431049:0:18594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244779880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18594:1869977659580672:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783350086.431189:0:18594:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21180 going to sleep for 11 seconds 00000100:00100000:0.0:1783350086.434935:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.435054:0:18594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244779880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18594:1869977659580672:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783350086.435099:0:18594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 8 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.435315:0:18594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8f000, rc 0) 00000100:00100000:1.0:1783350086.435454:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642737280 00000100:00100000:1.0:1783350086.435461:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642737280 00010000:00010000:1.0:1783350086.435495:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089ae184e/0xd05e6ae1590e396d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f0 expref: 9 pid: 18595 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350086.435573:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:1.0:1783350086.435583:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:2400:x1869977642737280:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783350086.435596:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350086.435613:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089ae184e/0xd05e6ae1590e396d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f0 expref: 9 pid: 18595 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.435626:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089ae184e/0xd05e6ae1590e396d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f0 expref: 9 pid: 18595 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.435647:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ae184e/0xd05e6ae1590e396d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f0 expref: 9 pid: 18595 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.435661:0:17074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350086.435671:0:17074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350086.435678:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 8 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.435689:0:17074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 8 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.435719:0:17074:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 8 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350086.435732:0:17074:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17074:1869977659580800:192.168.203.50@tcp:105: 00000100:00100000:1.0:1783350086.435797:0:17074:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f79cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783350086.436169:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36cceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+8:15632:x1869977642737152:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 5274us (9711us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350086.436178:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:1.0:1783350086.438945:0:17074:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17074:1869977659580800:192.168.203.50@tcp:105: 00010000:00010000:1.0:1783350086.438971:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350086.439027:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:2400:x1869977642737280:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 3444us (4099us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350086.439037:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:3.0:1783350086.440348:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.440484:0:19278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642737408 00000100:00100000:0.0:1783350086.440493:0:19278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642737408 00000100:00100000:0.0:1783350086.440544:0:19278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:0.0:1783350086.440554:0:19278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:2400:x1869977642737408:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783350086.440712:0:19278:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783350086.440716:0:19278:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1783350084 00002000:00010000:0.0:1783350086.440718:0:19278:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1783350083 00002000:00010000:0.0:1783350086.440720:0:19278:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1783350085 -> 1783350084 00002000:00010000:0.0:1783350086.440723:0:19278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1783350086.440762:0:19278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+8:2400:x1869977642737408:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 210us (421us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783350086.440768:0:19278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:3.0:1783350086.445488:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.445694:0:19527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642737536 00000100:00100000:2.0:1783350086.445705:0:19527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642737536 00000100:00100000:2.0:1783350086.445758:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:2.0:1783350086.445767:0:19527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea347667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a2801b7-a361-434c-b0c3-f6ccaa904300+8:2400:x1869977642737536:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783350086.445810:0:19527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.445829:0:19527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 8 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.445837:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783350086.445841:0:19527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783350086.445846:0:19527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.445880:0:19527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 8 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.445895:0:19527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 8 pid: 18594 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350086.445935:0:19527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea244779880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19527:1869977659580928:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783350086.446015:0:19527:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21180 going to sleep for 11 seconds 00000100:00100000:2.0:1783350086.450332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.450603:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642737664 00000100:00100000:0.0:1783350086.450613:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642737664 00010000:00010000:0.0:1783350086.450651:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 9 pid: 18594 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350086.450715:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:0.0:1783350086.450725:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:2400:x1869977642737664:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350086.450741:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350086.450760:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 9 pid: 18594 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.450774:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 9 pid: 18594 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.450799:0:17072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783350086.450803:0:17072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783350086.450808:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.450817:0:17072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.450838:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350086.450902:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+9:2400:x1869977642737664:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 177us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350086.450910:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00010000:00010000:3.0:1783350086.451048:0:19527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4f95857/0xd05e6ae1590e397b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3f7 expref: 8 pid: 18594 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350086.451074:0:19527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea244779880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19527:1869977659580928:192.168.203.50@tcp:104: 00010000:00010000:3.0:1783350086.451094:0:19527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.451104:0:19527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.451122:0:19527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.451194:0:19527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.451202:0:19527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.451210:0:19527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.451217:0:19527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ea00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:3.0:1783350086.451221:0:19527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.451229:0:19527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.451259:0:19527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.451268:0:19527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000126d87f5/0xd05e6ae1590e3982 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350086.451313:0:19527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea347667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a2801b7-a361-434c-b0c3-f6ccaa904300+7:2400:x1869977642737536:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 5547us (5835us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350086.451322:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:3.0:1783350086.454477:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.459375:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642737920 00000100:00100000:0.0:1783350086.459390:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642737920 00000100:00100000:0.0:1783350086.459463:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:0.0:1783350086.459474:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+16:15632:x1869977642737920:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783350086.459568:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.459584:0:17087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b8 expref: 16 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.459594:0:17087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.459629:0:17087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b8 expref: 16 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.459643:0:17087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b8 expref: 16 pid: 17088 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350086.459656:0:17087:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17087:1869977659581056:192.168.203.50@tcp:104: 00000100:00100000:0.0:1783350086.459747:0:17087:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3508ce240 going to sleep for 11 seconds 00000100:00100000:3.0:1783350086.464761:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.465398:0:17087:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17087:1869977659581056:192.168.203.50@tcp:104: 00010000:00010000:0.0:1783350086.465425:0:17087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350086.465535:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642738048 00000100:00100000:1.0:1783350086.465543:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642738048 00010000:00010000:1.0:1783350086.465577:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b8 expref: 17 pid: 17088 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350086.465612:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:1.0:1783350086.465621:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+17:2399:x1869977642738048:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783350086.465635:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783350086.465642:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b8 expref: 17 pid: 17088 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.465665:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b8 expref: 17 pid: 17088 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.465686:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364be00/0xd05e6ae1590e38d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3b8 expref: 17 pid: 17088 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.465701:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:1.0:1783350086.465706:0:17074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602e00/0xd05e6ae1590e38ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3c6 expref: 16 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.465715:0:17074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.465722:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.465729:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.465759:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783350086.465809:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a2801b7-a361-434c-b0c3-f6ccaa904300+16:2399:x1869977642738048:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 189us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350086.465817:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00010000:00010000:2.0:1783350086.466253:0:17087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.466261:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.466461:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.466473:0:17087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3958 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e2 expref: 16 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.466481:0:17087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.466510:0:17087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3958 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e2 expref: 16 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.466524:0:17087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3958 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e2 expref: 16 pid: 17089 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350086.466537:0:17087:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17087:1869977659581184:192.168.203.50@tcp:104: 00000100:00100000:2.0:1783350086.466591:0:17087:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f210c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783350086.470827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.470902:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642738176 00000100:00100000:0.0:1783350086.470910:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642738176 00010000:00010000:0.0:1783350086.470945:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3958 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e2 expref: 17 pid: 17089 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350086.470981:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:0.0:1783350086.470990:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+17:2400:x1869977642738176:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783350086.471016:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783350086.471023:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3958 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e2 expref: 17 pid: 17089 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.471036:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3958 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e2 expref: 17 pid: 17089 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.471056:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:0.0:1783350086.471060:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.471069:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.471076:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.471093:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783350086.471185:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+17:2400:x1869977642738176:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 195us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350086.471193:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00010000:00010000:2.0:1783350086.472506:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3958 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3e2 expref: 16 pid: 17089 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350086.472540:0:17087:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17087:1869977659581184:192.168.203.50@tcp:104: 00010000:00010000:2.0:1783350086.472563:0:17087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.472571:0:17087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.472576:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783350086.472678:0:17087:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1783350086.472788:0:17087:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1783350086.472823:0:17087:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1783350086.472897:0:17087:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17087:1869977659581312:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783350086.472954:0:17087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350086.473042:0:17087:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21180 going to sleep for 11 seconds 00000100:00100000:0.0:1783350086.480390:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659581312 00000100:00100000:0.0:1783350086.480406:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659581312 00000100:00100000:0.0:1783350086.480482:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783350086.480493:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17087:x1869977659581312:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783350086.481214:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17087:x1869977659581312:12345-0@lo:1000:mdt00_000.0 Request processed in 720us (8256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783350086.481224:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783350086.482094:0:17087:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17087:1869977659581312:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1783350086.482331:0:17087:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1783350086.482531:0:17087:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17087:1869977659581440:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783350086.482587:0:17087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350086.482620:0:17087:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea3586a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1783350086.482692:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659581440 00000100:00100000:3.0:1783350086.482699:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659581440 00000100:00100000:3.0:1783350086.482750:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783350086.482758:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17087:x1869977659581440:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783350086.482914:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17087:x1869977659581440:12345-0@lo:1000:mdt00_000.0 Request processed in 157us (326us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1783350086.482932:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783350086.483288:0:17087:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17087:1869977659581440:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783350086.483329:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483340:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483480:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483487:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8ee00 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350086.483491:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483499:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483515:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:2.0:1783350086.483519:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783350086.483523:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483529:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e3990 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483563:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483570:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483576:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483581:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602200 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350086.483584:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483601:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483611:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:2.0:1783350086.483613:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783350086.483620:0:17087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602e00/0xd05e6ae1590e38ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3c6 expref: 19 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483630:0:17087:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602e00/0xd05e6ae1590e38ef lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3c6 expref: 19 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483638:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602e00/0xd05e6ae1590e38ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3c6 expref: 19 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.483688:0:17087:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602e00/0xd05e6ae1590e38ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3c6 expref: 19 pid: 19423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783350086.483701:0:17087:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a39180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17087:1869977659581568:192.168.203.50@tcp:105: 00000100:00100000:2.0:1783350086.483768:0:17087:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ea357f21b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783350086.491096:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.491507:0:17087:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a39180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17087:1869977659581568:192.168.203.50@tcp:105: 00010000:00010000:2.0:1783350086.491534:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491545:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea374602200/0xd05e6ae1590e38e8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491576:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3997 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350086.491598:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642738304 00010000:00010000:2.0:1783350086.491600:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3997 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350086.491605:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642738304 00010000:00010000:2.0:1783350086.491611:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3997 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491621:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3997 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491627:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3997 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491633:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3997 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491638:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea36da8e400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350086.491641:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3997 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350086.491646:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00010000:00010000:2.0:1783350086.491648:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3997 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350086.491654:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea243032850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+20:15631:x1869977642738304:12345-192.168.203.50@tcp:49:dd.0 00010000:00010000:2.0:1783350086.491659:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:2.0:1783350086.491662:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783350086.491665:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3997 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491671:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e3997 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491679:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491690:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491695:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491699:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364b400 already unused, calling callback (ffffffffc19724f0) 00010000:00010000:2.0:1783350086.491701:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491707:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491714:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:2.0:1783350086.491716:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783350086.491719:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.491724:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea24364b400/0xd05e6ae1590e3989 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783350086.491767:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea243032850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+20:15631:x1869977642738304:12345-192.168.203.50@tcp:49:dd.0 Request processed in 113us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350086.491784:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000040:00080000:2.0:1783350086.491876:0:17125:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783350086.491881:0:17125:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783350086.492428:0:17125:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783350086.492435:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783350086.492513:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+19:15632:x1869977642737920:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 33038us (38042us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1783350086.492521:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 63 00000020:00080000:2.0:1783350086.492525:0:17087:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1783350086.495672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350086.495746:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642738560 00000100:00100000:3.0:1783350086.495756:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642738560 00000100:00100000:3.0:1783350086.495810:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:3.0:1783350086.495820:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+19:15632:x1869977642738560:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783350086.496267:0:17091:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783350086.496297:0:17091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1783350086.496330:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.496346:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.496458:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.496467:0:17091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.496474:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.496480:0:17091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783350086.496496:0:17091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783350086.496506:0:19530:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783350086.496524:0:19530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.496530:0:19530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea3582cd400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350086.496534:0:19530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.496540:0:19530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.496553:0:19530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ea34815b600) 00010000:00010000:2.0:1783350086.496556:0:19530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783350086.496559:0:19530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.496565:0:19530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea3582cd400/0xd05e6ae1590e399e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.496577:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350086.496579:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783350086.496580:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350086.496622:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+21:15632:x1869977642738560:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 801us (956us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1783350086.496630:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000020:00080000:3.0:1783350086.496641:0:17091:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783350086.507089:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350086.507588:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642738688 00000100:00100000:2.0:1783350086.507599:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642738688 00000100:00100000:2.0:1783350086.507657:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:2.0:1783350086.507667:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+21:15631:x1869977642738688:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:2.0:1783350086.507688:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783350086.507707:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e39a5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf6cd9018a5ded3fe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.507741:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e39ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.507768:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e39ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.507780:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e39ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.507907:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8e400/0xd05e6ae1590e39a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3fe expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.507924:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ea36da8ee00/0xd05e6ae1590e39ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0xf6cd9018a5ded3fe expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350086.507932:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ea2431f9100) 00010000:00010000:2.0:1783350086.507935:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783350086.507939:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ea36da8ee00, rc 0) 00000100:00100000:2.0:1783350086.508001:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+22:15631:x1869977642738688:12345-192.168.203.50@tcp:101:dd.0 Request processed in 335us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350086.508014:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:3.0:1783350086.838696:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350086.838751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1783350086.839601:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642738816 00000100:00100000:0.0:1783350086.839612:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642738816 00000100:00100000:0.0:1783350086.839672:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642738944 00000100:00100000:0.0:1783350086.839676:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642738944 00000100:00100000:0.0:1783350086.839699:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:0.0:1783350086.839707:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+8:2402:x1869977642738816:12345-192.168.203.50@tcp:4:dd.0 00002000:00010000:0.0:1783350086.839753:0:18599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a4bc344, atime: 0x6a4bc343, ctime: 0x6a4bc344, blocks: 0x0 00010000:00010000:0.0:1783350086.839764:0:18599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023dd671c/0xd05e6ae1590e39b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.839780:0:18599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1783350086.839784:0:18599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783350086.839791:0:18599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023dd671c/0xd05e6ae1590e39b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783350086.839803:0:18599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023dd671c/0xd05e6ae1590e39b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783350086.971543:0:18590:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1783350086.971562:0:18590:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1783350086.981753:0:18599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1783350086.981762:0:18599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1783350084 -> 1783350086 00002000:00010000:1.0:1783350086.981766:0:18599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1783350084 -> 1783350086 00002000:00010000:1.0:1783350086.981768:0:18599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1783350086.981786:0:18599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023dd671c/0xd05e6ae1590e39b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.981799:0:18599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023dd671c/0xd05e6ae1590e39b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.981807:0:18599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023dd671c/0xd05e6ae1590e39b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.981814:0:18599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea24364ba00 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:1.0:1783350086.981819:0:18599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023dd671c/0xd05e6ae1590e39b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.981827:0:18599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023dd671c/0xd05e6ae1590e39b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.981847:0:18599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023dd671c/0xd05e6ae1590e39b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.981855:0:18599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023dd671c/0xd05e6ae1590e39b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783350086.982088:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+6:2402:x1869977642738816:12345-192.168.203.50@tcp:4:dd.0 Request processed in 142376us (143398us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1783350086.982101:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:1.0:1783350086.982272:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:1.0:1783350086.982285:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642738944:12345-192.168.203.50@tcp:4:dd.0 00002000:00010000:1.0:1783350086.982324:0:18599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a4bc346, atime: 0x6a4bc343, ctime: 0x6a4bc346, blocks: 0x2000 00010000:00010000:1.0:1783350086.982331:0:18599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e39ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.982342:0:18599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1783350086.982480:0:18599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783350086.982487:0:18599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e39ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783350086.982500:0:18599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e39ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783350087.045901:0:18590:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1783350087.046347:0:18599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1783350087.046353:0:18599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1783350087.046372:0:18599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e39ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350087.046385:0:18599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e39ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350087.046395:0:18599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e39ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350087.046417:0:18599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ea374602400 already unused, calling callback (ffffffffc0d68d40) 00010000:00010000:2.0:1783350087.046422:0:18599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e39ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350087.046430:0:18599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e39ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350087.046447:0:18599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e39ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783350087.046454:0:18599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d49f219/0xd05e6ae1590e39ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783350087.050648:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642738944:12345-192.168.203.50@tcp:4:dd.0 Request processed in 68357us (211885us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783350087.050664:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00010000:00010000:3.0:1783350087.364314:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783350088.070318:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659581696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783350088.070385:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350088.070436:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783350088.070445:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659581824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783350088.070468:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350088.070502:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659581696 00000100:00100000:3.0:1783350088.070509:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659581696 00000100:00100000:3.0:1783350088.070556:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659581824 00000100:00100000:3.0:1783350088.070559:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659581824 00000100:00100000:3.0:1783350088.070576:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783350088.070585:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659581696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783350088.070612:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:3.0:1783350088.070655:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869977659581696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350088.070662:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783350088.070678:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783350088.070684:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659581824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783350088.070703:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783350088.070738:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659581824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350088.070744:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783350088.070784:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659581824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783350088.070811:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1783350088.070830:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ea37f5c9500, transno 8589934596 00000004:00080000:3.0:1783350088.070842:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1783350088.070859:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea2437fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869977659581696:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783350088.070979:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783350088.070983:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783350088.071013:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659581952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783350088.071030:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea37f5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659582080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783350088.071037:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350088.071056:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783350088.071068:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659581952 00000100:00100000:3.0:1783350088.071071:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659581952 00000100:00100000:1.0:1783350088.071080:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659582080 00000100:00100000:1.0:1783350088.071083:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659582080 00000100:00100000:3.0:1783350088.071095:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783350088.071100:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659581952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783350088.071110:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:3.0:1783350088.071317:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869977659581952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 214us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350088.071323:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783350088.071336:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783350088.071341:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659582080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783350088.071352:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783350088.071387:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea37f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869977659582080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350088.071394:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783350088.071427:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869977659582080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783350088.071429:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659582208:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.071468:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350088.071906:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659582336:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.071936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350088.071977:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659582336 00000100:00100000:2.0:1783350088.071982:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659582336 00000100:00100000:2.0:1783350088.072012:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783350088.072020:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659582336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.072060:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659582336:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.072066:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783350088.072104:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659582336:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.072190:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783350088.072196:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659582464:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.072221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350088.072246:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659582464 00000100:00100000:2.0:1783350088.072250:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659582464 00000100:00100000:2.0:1783350088.072423:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783350088.072431:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659582464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.072471:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869977659582464:12345-0@lo:400:kworker.0 Request processed in 42us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.072546:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783350088.072576:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869977659582464:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.072611:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783350088.072618:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659582592:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.072642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350088.072670:0:17828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659582592 00000100:00100000:2.0:1783350088.072673:0:17828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659582592 00000100:00100000:1.0:1783350088.072687:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659582208 00000100:00100000:1.0:1783350088.072693:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659582208 00000100:00100000:2.0:1783350088.072715:0:17828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783350088.072726:0:17828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659582592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350088.072731:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783350088.072741:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659582208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.072766:0:17828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869977659582592:12345-0@lo:400:kworker.0 Request processed in 43us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.072773:0:17828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783350088.072805:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869977659582592:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.072814:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ee7701a-0ad8-4622-a3a4-e9603bf4c749:3647:1869977659582208:0@lo:400:kworker.0 00000100:00100000:1.0:1783350088.072829:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ee7701a-0ad8-4622-a3a4-e9603bf4c749+24:3647:x1869977659582208:12345-0@lo:400:kworker.0 Request processed in 52us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.072848:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659582720:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.072870:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350088.072908:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659582720 00000100:00100000:2.0:1783350088.072912:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659582720 00000100:00100000:2.0:1783350088.072934:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783350088.072940:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659582720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.072974:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869977659582720:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.072980:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783350088.072998:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783350088.073008:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869977659582720:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.073041:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659582848:0@lo:400:kworker.0 00000100:00100000:1.0:1783350088.073061:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea37f5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869977659581952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783350088.073069:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350088.073100:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659582848 00000100:00100000:2.0:1783350088.073103:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659582848 00000100:00100000:2.0:1783350088.073174:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783350088.073180:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659582848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.073209:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869977659582848:12345-0@lo:400:kworker.0 Request processed in 30us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.073215:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783350088.073238:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869977659582848:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.073277:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659582976:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.073299:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783350088.073331:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659582976 00000100:00100000:1.0:1783350088.073336:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659582976 00000100:00100000:2.0:1783350088.073356:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783350088.073363:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659583104:0@lo:400:kworker.0 00000100:00100000:1.0:1783350088.073371:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783350088.073380:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659582976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.073390:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350088.073418:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659583104 00000100:00100000:2.0:1783350088.073421:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659583104 00000100:00100000:1.0:1783350088.073428:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869977659582976:12345-0@lo:400:kworker.0 Request processed in 48us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350088.073436:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783350088.073454:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783350088.073470:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659583104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783350088.073501:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869977659583104:12345-0@lo:400:kworker.0 Request processed in 41us (111us total) trans 0 rc 0/0 00010000:00080000:2.0:1783350088.073884:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea350a39180 x1869977659582976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350088.073905:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869977659582976:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.073933:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869977659583104:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.073963:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659583232:0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.073986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350088.074021:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659583232 00000100:00100000:2.0:1783350088.074025:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659583232 00000100:00100000:2.0:1783350088.074049:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783350088.074056:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659583232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783350088.074089:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869977659583232:12345-0@lo:400:kworker.0 Request processed in 34us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.074106:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1783350088.074581:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ea350a3ad80 x1869977659583232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783350104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783350088.074593:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869977659583232:0@lo:400:kworker.0 00000100:00080000:2.0:1783350088.074640:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783350088.074644:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783350088.074646:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783350088.074649:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783350088.074951:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783350088.278223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350088.278286:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350088.278312:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350088.278333:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350088.278369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350088.279035:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350088.279063:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350088.279075:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642739328 00000100:00100000:3.0:1783350088.279082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1783350088.279086:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642739328 00000100:00100000:3.0:1783350088.279105:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1783350088.279164:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642739584 00000100:00100000:3.0:1783350088.279168:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642739584 00000100:00100000:2.0:1783350088.279178:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642739840 00000100:00100000:2.0:1783350088.279182:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642739840 00000100:00100000:3.0:1783350088.279202:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642740096 00000100:00100000:3.0:1783350088.279206:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642740096 00000100:00100000:2.0:1783350088.279207:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642739200 00000100:00100000:2.0:1783350088.279212:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642739200 00000100:00100000:3.0:1783350088.279228:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642739456 00000100:00100000:3.0:1783350088.279232:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642739456 00000100:00100000:2.0:1783350088.279238:0:19423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642739712 00000100:00100000:2.0:1783350088.279243:0:19423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642739712 00000100:00100000:3.0:1783350088.279250:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642739968 00000100:00100000:3.0:1783350088.279255:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642739968 00000100:00100000:3.0:1783350088.279282:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:2.0:1783350088.279292:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:3.0:1783350088.279293:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642739584:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350088.279305:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642739328:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350088.279637:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642739584:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 82us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350088.279647:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:2.0:1783350088.279727:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642739328:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 425us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350088.279839:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:3.0:1783350088.279855:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642740096:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350088.279880:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642740096:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 28us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350088.279886:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:3.0:1783350088.279896:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:3.0:1783350088.279901:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642739456:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350088.279918:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a2801b7-a361-434c-b0c3-f6ccaa904300+5:2402:x1869977642739456:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 17us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350088.279930:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:3.0:1783350088.279940:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1783350088.279945:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642739968:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350088.280083:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:2.0:1783350088.280102:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:2.0:1783350088.280110:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642739840:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350088.280127:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642739968:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 20us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350088.280158:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:2.0:1783350088.280177:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+5:2402:x1869977642739840:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 67us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1783350088.280184:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:1.0:1783350088.280230:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977642739072 00000100:00100000:1.0:1783350088.280235:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977642739072 00000100:00100000:1.0:1783350088.280264:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 167 00000100:00100000:1.0:1783350088.280269:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea36dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2402:x1869977642739072:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1783350088.280293:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea36dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02fc5821-de16-4655-b2ee-a46099f9f1d8+13:2402:x1869977642739072:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 25us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1783350088.280299:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 167 00000100:00100000:3.0:1783350088.280348:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+22:2402:x1869977642739200:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1783350088.280438:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a2801b7-a361-434c-b0c3-f6ccaa904300+22:2402:x1869977642739200:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 247us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.281548:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:2.0:1783350088.281580:0:19423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:2.0:1783350088.281592:0:19423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2402:x1869977642739712:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1783350088.281636:0:19423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea2437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a332e1-ec8f-4f86-8530-dd43a8d09e28+6:2402:x1869977642739712:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 49us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.281643:0:19423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00080000:2.0:1783350088.281661:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783350088.281666:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783350088.281668:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783350088.281670:0:17083:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783350088.282934:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 70 00010000:00010000:1.0:1783350088.397249:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783350088.584226:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659583360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783350088.584412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350088.584453:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783350088.584460:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ea350a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659583488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350088.584487:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783350088.584544:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659583360 00000100:00100000:2.0:1783350088.584559:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659583360 00000100:00100000:2.0:1783350088.584604:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977659583488 00000100:00100000:2.0:1783350088.584608:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977659583488 00000100:00100000:2.0:1783350088.584627:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783350088.584637:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659583360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783350088.584673:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1783350088.584721:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869977659583360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.584729:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783350088.584750:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783350088.584758:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ea350a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659583488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783350088.584776:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783350088.584805:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ea350a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869977659583488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783350088.584812:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783350088.584860:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869977659583488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783350088.584875:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ea350a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869977659583360:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1783350088.758365:0:20279:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1783350089.413779:0:19530:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783350089.604694:0:17125:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783350089.604703:0:17125:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783350089.604722:0:17125:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783350089.604729:0:17125:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1783350090.438691:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41882 lines, 41882 kept, 0 dropped, 0 bad.